MyBB Community Forums

Can someone explain what they are and how I can make it work with MyBB?

A sitemap informs search engines about URLs on your site.

A robots.txt file allows you to tell search robots which pages you want them to visit.

The Google SEO plugin creates a sitemap for you.

Alternatively try this for your sitemap: http://www.xml-sitemaps.com/
Have a look at this for your robots.txt file: http://www.thesitewizard.com/archive/robotstxt.shtml

Sitemaps are best for sites with complicated structures that might be hard to crawl for a bot. MyBB sites are relatively easy to crawl and a sitemap probably won't be needed.

A robots.txt is easy to add. You should just grab a simple one though to start with.

Here is a simple one:
http://www.mybb.com/robots.txt

Here is a complex one:
http://www.google.com/robots.txt

Here is what I recommend for a default MyBB installation:

http://www.mybbcentral.com/robots.txt

Add pages to suit your needs.

Thanks for all the information. I will look into this more. Feel free to add more if you'd like.

(2012-10-07, 07:34 AM)labrocca Wrote: [ -> ]Sitemaps are best for sites with complicated structures that might be hard to crawl for a bot. MyBB sites are relatively easy to crawl and a sitemap probably won't be needed.

A robots.txt is easy to add. You should just grab a simple one though to start with.

Here is a simple one:
http://www.mybb.com/robots.txt

Here is a complex one:
http://www.google.com/robots.txt

Here is what I recommend for a default MyBB installation:

http://www.mybbcentral.com/robots.txt

Add pages to suit your needs.

Thank you! +1 rep!