MyBB Community Forums

MyBB Community Forums > Community > General Discussion > Question about of my robots.txt =D
Full Version: Question about of my robots.txt =D
You're currently viewing a stripped down version of our content. View the full version with proper formatting.

Solstice

2010-06-25, 04:41 AM
it is correct?? or have any error??

Sitemap: http://www.wmlatino.net/sitemap.xml

User-Agent: *
Allow: /
Disallow: /foro/images/
Disallow: /foro/admin/
Disallow: /foro/cache/
Disallow: /foro/images/
Disallow: /foro/inc/
Disallow: /foro/cometchat/
Disallow: /foro/games/
Disallow: /foro/install/
Disallow: /foro/jscripts/
Disallow: /foro/uploads/
Disallow: /foro/archive/
Disallow: /foro/arcade.php
Disallow: /foro/attachment.php
Disallow: /foro/calendar.php
Disallow: /foro/captcha.php
Disallow: /foro/ccpic.php
Disallow: /foro/contact.php
Disallow: /foro/css.php
Disallow: /foro/editpost.php
Disallow: /foro/error_404.php
Disallow: /foro/games.php
Disallow: /foro/global.php
Disallow: /foro/links.php
Disallow: /foro/links_logo.php
Disallow: /foro/managegroup.php
Disallow: /foro/member.php
Disallow: /foro/memberlist.php
Disallow: /foro/misc.php
Disallow: /foro/modcp.php
Disallow: /foro/moderation.php
Disallow: /foro/myachievements.php
Disallow: /foro/myawards.php
Disallow: /foro/myref.php
Disallow: /foro/newpoints.php
Disallow: /foro/newthread.php
Disallow: /foro/newreply.php
Disallow: /foro/online.php
Disallow: /foro/plaza.php
Disallow: /foro/pm.php
Disallow: /foro/polls.php
Disallow: /foro/pp.php
Disallow: /foro/private.php
Disallow: /foro/printthread.php
Disallow: /foro/refer.php
Disallow: /foro/ratethread.php
Disallow: /foro/report.php
Disallow: /foro/reputation.php
Disallow: /foro/search.php
Disallow: /foro/sendthread.php
Disallow: /foro/shoutbox.php
Disallow: /foro/showteam.php
Disallow: /foro/statsig.php
Disallow: /foro/tournaments.php
Disallow: /foro/userbar.php
Disallow: /foro/usercp.php
Disallow: /foro/userbarsettings.php
Disallow: /foro/usercp2.php
Disallow: /foro/task.php
Disallow: /foro/warnings.php
Disallow: /foro/xmlhttp.php

User-agent: Googlebot
# disallow files ending with these extensions
Disallow: /*.inc$
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.css$

# disallow all files with? in url
Disallow: *mark=*
Disallow: *view=*

# allow google image bot to search all images
User-agent: Googlebot-Image
Disallow:
Allow: /*

# allow adsense bot on entire site
User-agent: Mediapartners-Google*
Disallow:
Allow: /*

Tom K.

2010-06-25, 08:18 AM
My robots foo isn't great but that looks fine Smile

Solstice

2010-06-25, 12:04 PM
=D thanks tommy ^^

more commets??

faviouz

2010-06-25, 12:26 PM
Take a look at Google SEO's robots.txt

I use it and it's alright.

Solstice

2010-06-25, 01:03 PM
but i dont use google seo :/

faviouz

2010-06-25, 01:12 PM
You don't need to. Just grab the robots.txt file.

Solstice

2010-06-25, 01:33 PM
i dont understand Sad?????


(2010-06-25, 04:41 AM)Walkman 5.0 Wrote: [ -> ]it is correct?? or have any error??

Sitemap: http://www.wmlatino.net/sitemap.xml

User-Agent: *
Allow: /
Disallow: /foro/images/
Disallow: /foro/admin/
Disallow: /foro/cache/
Disallow: /foro/images/
Disallow: /foro/inc/
Disallow: /foro/cometchat/
Disallow: /foro/games/
Disallow: /foro/install/
Disallow: /foro/jscripts/
Disallow: /foro/uploads/
Disallow: /foro/archive/
Disallow: /foro/arcade.php
Disallow: /foro/attachment.php
Disallow: /foro/calendar.php
Disallow: /foro/captcha.php
Disallow: /foro/ccpic.php
Disallow: /foro/contact.php
Disallow: /foro/css.php
Disallow: /foro/editpost.php
Disallow: /foro/error_404.php
Disallow: /foro/games.php
Disallow: /foro/global.php
Disallow: /foro/links.php
Disallow: /foro/links_logo.php
Disallow: /foro/managegroup.php
Disallow: /foro/member.php
Disallow: /foro/memberlist.php
Disallow: /foro/misc.php
Disallow: /foro/modcp.php
Disallow: /foro/moderation.php
Disallow: /foro/myachievements.php
Disallow: /foro/myawards.php
Disallow: /foro/myref.php
Disallow: /foro/newpoints.php
Disallow: /foro/newthread.php
Disallow: /foro/newreply.php
Disallow: /foro/online.php
Disallow: /foro/plaza.php
Disallow: /foro/pm.php
Disallow: /foro/polls.php
Disallow: /foro/pp.php
Disallow: /foro/private.php
Disallow: /foro/printthread.php
Disallow: /foro/refer.php
Disallow: /foro/ratethread.php
Disallow: /foro/report.php
Disallow: /foro/reputation.php
Disallow: /foro/search.php
Disallow: /foro/sendthread.php
Disallow: /foro/shoutbox.php
Disallow: /foro/showteam.php
Disallow: /foro/statsig.php
Disallow: /foro/tournaments.php
Disallow: /foro/userbar.php
Disallow: /foro/usercp.php
Disallow: /foro/userbarsettings.php
Disallow: /foro/usercp2.php
Disallow: /foro/task.php
Disallow: /foro/warnings.php
Disallow: /foro/xmlhttp.php

User-agent: Googlebot
# disallow files ending with these extensions
Disallow: /*.inc$
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.css$

# disallow all files with? in url
Disallow: *mark=*
Disallow: *view=*

# allow google image bot to search all images
User-agent: Googlebot-Image
Disallow:
Allow: /*

# allow adsense bot on entire site
User-agent: Mediapartners-Google*
Disallow:
Allow: /*

this is my robots.txt

darkly

2010-06-25, 01:34 PM
Just download Google SEO and copy the robots.txt file from there. Smile

Ryan Ashbrook

2010-06-25, 02:33 PM
It's fine.
MyBB Community Forums > Community > General Discussion > Question about of my robots.txt =D