MyBB Community Forums

MyBB Community Forums > Community Archive > Archived Forums > Archived Development and Support > MyBB 1.6 > 1.6 General Support > robots.txt wanted
Full Version: robots.txt wanted
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Pages: 1 2

Dishunters.com

2011-08-08, 05:54 AM
i want a robots.txt for this

"to allow search engines bots to easily detect the presence of a sitemap file of your board!" please anybody give it...

fizz

2011-08-08, 05:58 AM
http://www.mcanerin.com/en/search-engine/robots-txt.asp

There's this nifty new tool out there called Google...

Nathan Malcolm

2011-08-08, 05:59 AM
Sitemap: http://yourforum.com/path/to/sitemap.xml

Dishunters.com

2011-08-08, 06:01 AM
(2011-08-08, 05:59 AM)Malcolm. Wrote: [ -> ]Sitemap: http://yourforum.com/path/to/sitemap.xml

please write it sir

Nathan Malcolm

2011-08-08, 06:02 AM
(2011-08-08, 06:01 AM)Dishunters.com Wrote: [ -> ]
(2011-08-08, 05:59 AM)Malcolm. Wrote: [ -> ]Sitemap: http://yourforum.com/path/to/sitemap.xml

please write it sir

I did?

ranjani

2011-08-08, 06:12 AM
that is : just add sitemap: filepath to your sitemap in robots.txt file

Dishunters.com

2011-08-08, 06:18 AM
User-agent: *
Disallow:
Sitemap:www.dishunters.com/sitemap_forums_1.xml
Sitemap:www.dishunters.com/sitemap-index.xml
Sitemap:www.dishunters.com/sitemap_threads_1.xml
Sitemap:www.dishunters.com/sitemap_profiles_1.xml
Sitemap:www.dishunters.com/sitemap.php


does it correct please tell...

Nathan Malcolm

2011-08-08, 06:19 AM
Sitemap: http://www.dishunters.com/sitemap-index.xml
User-agent: *
//code

Omar G.

2011-08-08, 06:20 AM
Sitemap:www.dishunters.com/sitemap-index.xml

User-agent: *
Disallow:

/beaten

Dishunters.com

2011-08-08, 06:24 AM
User-agent: *
Allow: /sitemap_forums_1.xml
Allow: /sitemap.php
Allow: /sitemap_profiles_1.xml
Allow: /
Allow: /sitemap-index.xml
Allow: /sitemap_threads_1.xml
Allow: /sitemap.xml

created like this in google

https://www.google.com/webmasters/tools/...=generator
Pages: 1 2
MyBB Community Forums > Community Archive > Archived Forums > Archived Development and Support > MyBB 1.6 > 1.6 General Support > robots.txt wanted