MyBB Community Forums › Community Archive › Archived Forums › Archived Development and Support › MyBB 1.6 › 1.6 Suggestions and Feedback v
Does mybb supports robots.txt and attachment crawling?

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Threaded Mode
Does mybb supports robots.txt and attachment crawling?
Hemani Offline
Posts: 54
Threads: 18
Joined: Oct 2012
Reputation: 0
#1
2013-02-25, 10:56 PM (This post was last modified: 2013-02-25, 10:58 PM by Hemani.)
Hi,

1) I need to know where is the Robots.txt file of my mybb forum: http://vrlegends.com/robots.txt

2) I uploaded this thread ( http://www.vrlegends.com/Thread-CS301-Da...ruary.html ) with a .pdf attachment: http://www.vrlegends.com/attachment.php?aid=1987 but I found Google didn't crawl any of the attachment.

I don't have a good hand on mybb forum. Please guide me is there any disallow or hinder of attachments crawling?

3) I want Google to crawl all attachments with *all* extensions i.e. .doc, .docx, .pdf, .ppt etc.

Need help!

Thanks
Find
Nathan Malcolm Away

Former Staff
Posts: 13,646
Threads: 220
Joined: May 2010
Reputation: 549
#2
2013-02-25, 11:02 PM
1. You'll have to upload one yourself. The one provided with the Google SEO plugin is a good starter.

2/3. You've disallowed guests to download attachments so Google won't be able to index those pages.
No longer involved in the MyBB project.
Find
Paul H. Away

Former Staff
Posts: 8,509
Threads: 386
Joined: Feb 2011
Reputation: 279
#3
2013-02-25, 11:09 PM
In the ACP, you can go to configuration>Spiders/Bots>*whatever bot*>Edit Bot and change the usergroup it views as however, so they might look at attachments then.
-Paul H.

Cogisne lingua latina?
Find
Hemani Offline
Posts: 54
Threads: 18
Joined: Oct 2012
Reputation: 0
#4
2013-02-26, 12:49 AM
(2013-02-25, 11:02 PM)Nathan Malcolm Wrote: 1. You'll have to upload one yourself. The one provided with the Google SEO plugin is a good starter.

2/3. You've disallowed guests to download attachments so Google won't be able to index those pages.

Thanks Nathan.

I've changed the configuration settings. Now, un-registered members can also download the attachments.

Also, I need to know how to add Google Authorship Markup on the forum?
Find
pavemen Offline

Former Staff
Posts: 4,846
Threads: 180
Joined: May 2007
Reputation: 254
#5
2013-02-26, 01:55 AM
(2013-02-26, 12:49 AM)Hemani Wrote: Also, I need to know how to add Google Authorship Markup on the forum?

you need a Google+ account and then alter the header or headerinclude template to include

<link rel="author"  href="https://plus.google.com/<your g+ id>" />
<link rel="publisher"  href="https://plus.google.com/<your g+ id>" />

and then verify the ownership with the google webmaster tool, IIRC
Lost interest, sold my sites, will browse here once in a while. It's been fun.
Find
Hemani Offline
Posts: 54
Threads: 18
Joined: Oct 2012
Reputation: 0
#6
2013-02-26, 02:40 AM
(2013-02-26, 01:55 AM)pavemen Wrote:
(2013-02-26, 12:49 AM)Hemani Wrote: Also, I need to know how to add Google Authorship Markup on the forum?

you need a Google+ account and then alter the header or headerinclude template to include

<link rel="author"  href="https://plus.google.com/<your g+ id>" />
<link rel="publisher"  href="https://plus.google.com/<your g+ id>" />

and then verify the ownership with the google webmaster tool, IIRC

Thanks! I'll try this and let you know Smile
Find
meethere Offline
Posts: 65
Threads: 10
Joined: Jun 2013
Reputation: 0
#7
2013-07-15, 10:14 AM
This user has been denied support. This user has been denied support.
hi
I added the links and code but still google showing not added Sad
pls help
Find


Forum Jump:


Users browsing this thread: 1 Guest(s)