Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Not Solved How to prevent Google from indexing specific forum?
#1
Not Solved
I have a category which I want Google not to index, nor ANY threads inside it! I need help how to do that.

I am currently using Google SEO if that means something.

Thank you.
#2
Not Solved
I guess you can use the noindex meta tag, or block the google bot with robots.txt file?
#3
Not Solved
How do I do that with robots.txt? What is the "regex" expression of the threads in specific forum?
#4
Not Solved
(2013-10-26, 01:05 PM)Zer0 Key Wrote: How do I do that with robots.txt? What is the "regex" expression of the threads in specific forum?

create txt file named robots.txt , put this line into it:
User-agent: *
Disallow: /youforumname/

if for example your full forum url is: mybbforum.com
and you want to noindex : mybbforum.com/forum-1.html

then change "/yourforumname/" from the above example to "/forum-1.html"

upload the robots.txt file to your mybb roots directory (the directory where you install mybb)

There is a tool to create robots txt:
http://www.mcanerin.com/EN/search-engine/robots-txt.asp

hope that help
Get your Free Reseller Hosting , resell domain, hosting, vps. No upfront buying.
#5
Not Solved
Yeah, I already tried that, but it only blocks that specific forum from being indexed, it doesn't block any threads into it... :/
#6
Not Solved
Could just create a usergroup specifically for search spiders and then change it's permissions to what you want google and other search engines to see.
#7
Not Solved
You want to no index specifik thread, I missed that point.

You need to modify your url structure to include category name within thread url.
Get your Free Reseller Hosting , resell domain, hosting, vps. No upfront buying.
#8
Not Solved
(2013-10-26, 06:33 PM)Stefan C. Wrote: Could just create a usergroup specifically for search spiders and then change it's permissions to what you want google and other search engines to see.

This is the easiest and the best way in my opinion.

Here are the instructions.

Step # 1

Go to ACP>Users & Groups>Groups>Add New User Group>Copy Permissions from Guest.

Name it anything you want. I would use "Bots" for example.

Step # 2

Go to ACP>Configuration>Spiders/Bots>Google>Edit Bot>User Group>Bots

Step # 3

Go to ACP>Forums & Posts>Forum Management>FORUM NAME>Permissions

Set the custom permissions for your spiders/bots by customizing the permissions for the bots group. In your case, you would untick "Can view threads" and "Can view forum" in forum settings.
#9
Not Solved
You should be able to disable bots via ACP. Delete them, I've did it and never had a problem.
ACP>Configuration>Spiders / Bots
#10
Not Solved
(2013-10-27, 03:22 AM)Wage Wrote: You should be able to disable bots via ACP. Delete them, I've did it and never had a problem.
ACP>Configuration>Spiders / Bots

The OP wants to disallow bots from accessing a certain forum, not the whole board.


Forum Jump:


Users browsing this thread: 1 Guest(s)