Is it possible to make my website invisible to searches and search engines? If it is possible, how can I do it?
![]() |
Upload robots.txt file to your forum root (where forumdisplay.php, showthread.php etc. are stored) with this content:
I would imagine removing all the spiders/bots would also work if guests are forced to sign in....
Do NOT pm me for support on ANY of my plugins
DO pm me if you got suggestions for existing ones (although posting in the proper thread is preferred), or suggestions/ideas for new plugins (keep in mind I'm an amateur but not necessarily a beginner.) (2015-02-19, 11:52 PM)Destroy666 Wrote: Upload robots.txt file to your forum root (where forumdisplay.php, showthread.php etc. are stored) with this content: This AND I would look up resources on blocking the Yandex search engine. Yandex has a bad reputation of not respecting robots.txt rules. If you don't want your site on a Russian search engine, you'll have to do that extra leg work too ![]()
PGP Key (Fingerprint: 23B6 F4C0 FE2D 45AA 61A0 1E86 DB87 09DC DD87 6E40)
For yandex (or other bots), you can use in .htaccess:
Oh, thanks guys, I was not ready to let people go into my website because it still need some works. Do tell me if any other search engines is not blocked out from the help of Crazycat & Destroy666. Once again, thanks guys for your help!
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)