Hello every body
Can anyone guide me how I prevent google from indexing my forum Admin login page? and to not show it in google search engine. Today I search my forum on google and it shocked me when I saw the admin login page with url. The problem is that I have renamed the forum root directory for security purpose and google was showing the page along with url in which the root directory name was clearly visible.
Thanks
in general, Google doesn't crawl to a specific page unless there is a link left somewhere on your forum / on the web
(2017-10-22, 12:06 PM).m. Wrote: [ -> ]in general, Google doesn't crawl to a specific page unless there is a link left somewhere on your forum / on the web
So what should I do now? I mean how I delete that link.
And thank you for response.
^ basically we do not add the admin folder to robots.txt file.
anyone can access robots.txt file and can guess about important folders & files
Yes like M said "don't add Admin to robots.txt" plus you should rename your admin folder anyway so having Admin Deny is pointless.
I would suggest you rename your admin folder again to something else. You must have left a link laying around soemwhere for Google to be able to find it.
You could try this:
https://support.google.com/webmasters/an...3419?hl=en
But always rename your admin folder, never give the URL to anyone or post it anywhere. Plus have a different username for Admin than the one you use on your forum. Also make sure you Bots are only viewing as guests, they should be by default but it's worth checking.
i use robots.txt to stop search engine
and
<Files robots.txt>
order allow,deny
deny from all
</Files>
to stop robots.txt acces
is it wrong??? i also need suggestion
(2017-10-22, 12:38 PM)sarisisop Wrote: [ -> ]Yes like M said "don't add Admin to robots.txt" plus you should rename your admin folder anyway so having Admin Deny is pointless.
I would suggest you rename your admin folder again to something else. You must have left a link laying around soemwhere for Google to be able to find it.
You could try this: https://support.google.com/webmasters/an...3419?hl=en
But always rename your admin folder, never give the URL to anyone or post it anywhere. Plus have a different username for Admin than the one you use on your forum. Also make sure you Bots are only viewing as guests, they should be by default but it's worth checking.
Thank you for such detail guidance.
(2017-10-22, 12:38 PM)sarisisop Wrote: [ -> ]Yes like M said "don't add Admin to robots.txt" plus you should rename your admin folder anyway so having Admin Deny is pointless.
I would suggest you rename your admin folder again to something else. You must have left a link laying around soemwhere for Google to be able to find it.
You could try this: https://support.google.com/webmasters/an...3419?hl=en
But always rename your admin folder, never give the URL to anyone or post it anywhere. Plus have a different username for Admin than the one you use on your forum. Also make sure you Bots are only viewing as guests, they should be by default but it's worth checking.
Can you please tell me which codes should i put in robot.txt file. I just searched my public_html folder and there I could not found it. So I want to create one but don't know how?
Your guidance will be highly appreciated.
(2017-10-22, 12:45 PM)ataulhaq Wrote: [ -> ]Can you please tell me which codes should i put in robot.txt file. I just searched my public_html folder and there I could not found it. So I want to create one but don't know how?
Your guidance will be highly appreciated.
You need to create a new file titled
robots.txt
Then you can add places you don't want the Bots to visit, for example I have this in mine.
User-agent: *
Disallow: /online.php
Disallow: /newthread.php
Disallow: /ratethread.php
Disallow: /printthread.php
Disallow: /calendar.php
Disallow: /member.php
Disallow: /usercp.php
Disallow: /usercp2.php
Disallow: /newreply.php
Disallow: /search.php
Disallow: /memberlist.php
Disallow: /private.php
Disallow: /member.php?action=register
You can also block Bots like this.
User-agent: Baiduspider
Disallow: /
User-agent: Yandex
Disallow: /
That's just an example, and you need to tailor it to your requirements. Some people don't bother using them and some bad bots will ignore them, but it can stop Google looking at pages you don't want them to see.