MyBB Community Forums

Full Version: Does mybb supports robots.txt and attachment crawling?
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Hi,

1) I need to know where is the Robots.txt file of my mybb forum: http://vrlegends.com/robots.txt

2) I uploaded this thread ( http://www.vrlegends.com/Thread-CS301-Da...ruary.html ) with a .pdf attachment: http://www.vrlegends.com/attachment.php?aid=1987 but I found Google didn't crawl any of the attachment.

I don't have a good hand on mybb forum. Please guide me is there any disallow or hinder of attachments crawling?

3) I want Google to crawl all attachments with *all* extensions i.e. .doc, .docx, .pdf, .ppt etc.

Need help!

Thanks
1. You'll have to upload one yourself. The one provided with the Google SEO plugin is a good starter.

2/3. You've disallowed guests to download attachments so Google won't be able to index those pages.
In the ACP, you can go to configuration>Spiders/Bots>*whatever bot*>Edit Bot and change the usergroup it views as however, so they might look at attachments then.
(2013-02-25, 11:02 PM)Nathan Malcolm Wrote: [ -> ]1. You'll have to upload one yourself. The one provided with the Google SEO plugin is a good starter.

2/3. You've disallowed guests to download attachments so Google won't be able to index those pages.

Thanks Nathan.

I've changed the configuration settings. Now, un-registered members can also download the attachments.

Also, I need to know how to add Google Authorship Markup on the forum?
(2013-02-26, 12:49 AM)Hemani Wrote: [ -> ]Also, I need to know how to add Google Authorship Markup on the forum?

you need a Google+ account and then alter the header or headerinclude template to include

<link rel="author"  href="https://plus.google.com/<your g+ id>" />
<link rel="publisher"  href="https://plus.google.com/<your g+ id>" />

and then verify the ownership with the google webmaster tool, IIRC
(2013-02-26, 01:55 AM)pavemen Wrote: [ -> ]
(2013-02-26, 12:49 AM)Hemani Wrote: [ -> ]Also, I need to know how to add Google Authorship Markup on the forum?

you need a Google+ account and then alter the header or headerinclude template to include

<link rel="author"  href="https://plus.google.com/<your g+ id>" />
<link rel="publisher"  href="https://plus.google.com/<your g+ id>" />

and then verify the ownership with the google webmaster tool, IIRC

Thanks! I'll try this and let you know Smile
hi
I added the links and code but still google showing not added Sad
pls help