MyBB Community Forums

Greetings,
I need to prevent direct access of robots.txt via url .

for examply my website : http://www.exaple.com/path/robots.txt

Is there any way to prevent direct access of this only froum browser .

Regards
Net_Spy

If search robots can access the file, so can any browser. There's no (good) way to prevent it. It's not a good idea to prevent it either because by default, everything is allowed for bots, so if you prevent access to robots.txt you'll have bots going crazy on your domain...

robots.txt usually does not contain confidential information. If you want to prevent access to a secret directory, you don't put it in robots.txt but you prevent access to it with other methods, such as HTTP Auth.

Ok thanks