Not Solved robots.txt for MyBB
#29
Not Solved
Thanks for the tips.

Currently this the robots.txt I am using:
User-agent: *

Disallow: /attachment.php
Disallow: /calendar.php
Disallow: /captcha.php
Disallow: /editpost.php
Disallow: /member.php?action=emailuser
Disallow: /member.php?action=login
Disallow: /member.php?action=logout
Disallow: /member.php?action=lostpw
Disallow: /member.php?action=register
Disallow: /memberlist.php
Disallow: /misc.php?action=markread
Disallow: /modcp.php
Disallow: /moderation.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /ratethread.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendthread.php
Disallow: /showteam.php
Disallow: /stats.php
Disallow: /task.php
Disallow: /usercp.php
Disallow: /usercp2.php

PS: I've added an entry to disallow attachment.php to stop Google from trying to download attachments.
-- NewEraCracker
Reply


Messages In This Thread
robots.txt for MyBB - by WbDev - 2012-01-07, 04:03 AM
RE: robots.txt for MyBB - by Jason L. - 2012-01-07, 04:10 AM
RE: robots.txt for MyBB - by WbDev - 2012-01-07, 04:12 AM
RE: robots.txt for MyBB - by weBex - 2012-01-07, 04:37 AM
RE: robots.txt for MyBB - by WbDev - 2012-01-07, 04:58 AM
RE: robots.txt for MyBB - by NewEraCracker - 2012-01-16, 06:53 PM
RE: robots.txt for MyBB - by t0p3a - 2012-01-16, 11:48 PM
RE: robots.txt for MyBB - by WbDev - 2012-01-17, 07:46 PM
RE: robots.txt for MyBB - by Amplifier - 2012-04-09, 03:53 PM
RE: robots.txt for MyBB - by armin3000 - 2012-05-02, 10:10 AM
RE: robots.txt for MyBB - by Mr.Kewl - 2012-05-02, 04:58 PM
RE: robots.txt for MyBB - by Solidus - 2012-05-02, 05:18 PM
RE: robots.txt for MyBB - by Starnova - 2012-06-09, 05:19 AM
RE: robots.txt for MyBB - by MadComp - 2012-06-09, 07:06 AM
RE: robots.txt for MyBB - by CAwesome - 2012-06-09, 09:27 AM
RE: robots.txt for MyBB - by MadComp - 2012-06-10, 02:54 AM
RE: robots.txt for MyBB - by Maj - 2012-06-10, 08:35 AM
RE: robots.txt for MyBB - by MadComp - 2012-06-11, 12:28 AM
RE: robots.txt for MyBB - by Maj - 2012-06-09, 10:14 AM
RE: robots.txt for MyBB - by Puppyite - 2012-06-09, 11:34 AM
RE: robots.txt for MyBB - by Zenk - 2012-06-09, 08:29 PM
RE: robots.txt for MyBB - by Maj - 2012-06-09, 08:38 PM
RE: robots.txt for MyBB - by Tom K. - 2012-06-09, 09:44 PM
RE: robots.txt for MyBB - by Puppyite - 2012-06-10, 01:07 AM
RE: robots.txt for MyBB - by Tom K. - 2012-06-10, 07:11 AM
RE: robots.txt for MyBB - by PsuedoK - 2013-04-13, 10:05 AM
RE: robots.txt for MyBB - by dthiago - 2013-05-26, 11:48 PM
RE: robots.txt for MyBB - by Maj - 2013-04-13, 10:59 AM
RE: robots.txt for MyBB - by NewEraCracker - 2013-09-12, 04:00 AM
RE: robots.txt for MyBB - by bitcoin - 2015-04-24, 11:02 PM
RE: robots.txt for MyBB - by talen_j - 2015-06-15, 04:43 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)