2015-08-18, 01:08 PM
any one help for Test my robot.txt
file
here the link
http://xdahackers.com/robots.txt
any problem..???
I AM ADDED SOME sitemap files
any problem for these
Thanks
file
here the link
http://xdahackers.com/robots.txt
any problem..???
I AM ADDED SOME sitemap files
Sitemap: http://xdahackers.com/sitemap-index.xml
User-Agent: *
Disallow: /captcha.php
Disallow: /editpost.php
Disallow: /misc.php
Disallow: /modcp.php
Disallow: /moderation.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /ratethread.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendthread.php
Disallow: /task.php
Disallow: /usercp.php
Disallow: /usercp2.php
Disallow: /calendar.php
Disallow: /*action=emailuser*
Disallow: /*action=nextnewest*
Disallow: /*action=nextoldest*
Disallow: /*year=*
Disallow: /*action=weekview*
Disallow: /*action=nextnewest*
Disallow: /*action=nextoldest*
Disallow: /*sort=*
Disallow: /*order=*
Disallow: /*mode=*
Disallow: /*datecut=*
Allow: /
Sitemap: http://xdahackers.com/sitemap-index.xml
sitemap: http://xdahackers.com/sitemap-forums.xml?page=1
sitemap: http://xdahackers.com/sitemap-threads.xml?page=1
sitemap: http://xdahackers.com/sitemap-threads.xml?page=2
sitemap: http://xdahackers.com/sitemap-users.xml?page=1
sitemap: http://xdahackers.com/sitemap-users.xml?page=2
sitemap: http://xdahackers.com/sitemap-users.xml?page=3
Sitemap: http://xdahackers.com/sitemap-users.xml?page=4
sitemap: http://xdahackers.com/sitemap-users.xml?page=5
sitemap: http://xdahackers.com/sitemap-announcements.xml?page=1
sitemap: http://xdahackers.com/sitemap-events.xml?page=1
sitemap: http://xdahackers.com/sitemap-index.xml?page=1
Sitemap: http//xdahackers.com/sitemap.XML
sitemap: http://xdahackers.com/misc.php?google_seo_sitemap=index
Sitemap : http://xdahackers.com/sitemap1.xml
sitemap: http://xdahackers.com/sitemap/sitemap.xml
sitemap: http://xdahackers.com/sitemap/sitemap1.xml
sitemap: http://xdahackers.com/main.xml
any problem for these
Thanks