MyBB Community Forums

Full Version: What does Google do on a page that doesn't exist?
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Viewing who's online (complete list), I see Google on location "Add event".
When I click on it it says: "The specified calendar does not exist. Are you sure you are visiting the correct page?"

The path is: {mydomainname} /calendar.php?action=addevent

I wonder what Googlebot (or simply Google) do on a page that doesn't exist?
Go to: ACP > Users and Groups > Groups > Guests > Edit > and Untick "Can post calendar events?" option Under "Miscellaneous" tab.
It's unchecked, i think this is the default

"Can view calendar" is checked instead.

By the way, I set Spiders/Bots as members of the "Registered Users" Group.
I have threads that are set to private where Human Guest can't view it but I want spiders/bots to see it for SEO purposes.
Google follows all links (except the ones with rel="nofollow" in them) and revisits pages that he already indexed on regular bases. If there is a link to that page or that page existed in the past, Google was just checking for updates. Even if it is a 404 page or "Permission denied" page. Although, a "Permission denied" page will show up differently in the Who's online-link.

(05-31-2011, 07:43 AM)KenWeiLL Wrote: [ -> ]By the way, I set Spiders/Bots as members of the "Registered Users" Group.
I have threads that are set to private where Human Guest can't view it but I want spiders/bots to see it for SEO purposes.
If Google can visit a private forum, guest can also view them via Google Cache so that is not really helpful.
No need for Google Cache even, anyone can just set their user agent to Google and then browse the supposedly member-only forums directly... which means that guests can even see stuff that Google won't index.
(05-31-2011, 05:10 PM)frostschutz Wrote: [ -> ]No need for Google Cache even, anyone can just set their user agent to Google and then browse the supposedly member-only forums directly... which means that guests can even see stuff that Google won't index.

Good point.
Oh.
I didn't know these.
Thanks for the info. I will set bots permission to guest again.