MyBB Community Forums

Full Version: Robots.txt file
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Do you guys have a recommended robots.txt file as a starting point for MyBB ??

If so please post your file, I think we need to add one so our boards are crawled more efficiently.
Hi,

You can try the one on these boards: http://community.mybboard.net/robots.txt
What about meta description in MyBB and meta keywords ?

How do we add those within the script or template for SEO ?
If you want to add META tags, you can do so by editing the headerinclude template.
If you're not familiar with HTML, here's a little guide you may want to look at: http://searchenginewatch.com/showPage.html?page=2167931
and htacess is important also to SEO, I don't think we have that taken care of properly either and it may be hurting us due to duplicate content penalties.

The forum in question is IndiaSearch.org

Thanks for the help and suggestions, there is more to this than simply installing the MyBB script on a server and making posts.
FYI, MyBB 1.4 has SEO URLs built in.
You mean redirects to eliminate duplicate content penalties, to consolidate www and non www URL's ?

Will this be automatic or administrator set ?

Would a stock robots.txt be a good idea to build in also ?
(2008-02-09, 05:39 PM)AVC Wrote: [ -> ]You mean redirects to eliminate duplicate content penalties, to consolidate www and non www URL's ?

Will this be automatic or administrator set ?

Would a stock robots.txt be a good idea to build in also ?
check this url