MyBB Community Forums

Full Version: Google crawling indexing lots of calender pages
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Pages: 1 2
till yesterday , there where only 40 pages indexed for my forums at www.desktophelp.in/forums , but now there are 2000 pages indexed

i am worried because out of 2000 pages indexed ,1900 pages are of calendar ,each page for each day ,

check the search result for yourself
http://www.google.com/search?client=oper...8&oe=utf-8

Wouldn't this will have negative impact for my site , at it is indexing blank calendar pages

can any body have any idea or would like to suggest me anything , i would be really greatful
I've noticed the google bot that comes onto your site it's always viewing the calendar at least on my site, so that could be why theres alot of calendar pages.
if i delete that bots then how will my site get indexed in google
Iv'e deleted that part about deleting, i'm not sure, but you might need a plugin or something to disallow google from viewing the calendar.
maybe robots.txt , i need a standard robots.txt for mybb forums
Actually, you can untick the "view calendar" option under miscellaneous for the guest group which google bot is apart of, so google bot won't be able to view the calendar, that should prevent the calendar from being indexed, you can also make a group called "bots" and put google bot into that group and untick "can view calendar".
Good Idea , anymore suggestions
The ones I've stated would probably be your best bet.
(2010-01-23, 08:56 AM)netjockey Wrote: [ -> ]maybe robots.txt , i need a standard robots.txt for mybb forums

http://lunaticoutpost.com/robots.txt

As far as i can tell my calendar is not being indexed.
(2010-01-23, 09:38 AM)Disturbed Wrote: [ -> ]
(2010-01-23, 08:56 AM)netjockey Wrote: [ -> ]maybe robots.txt , i need a standard robots.txt for mybb forums

http://lunaticoutpost.com/robots.txt

As far as i can tell my calendar is not being indexed.

Good one Can i copy your robots.txt ? , do i need to make any changes , mybb forums is installed at www.desktophelp.in/forums
Pages: 1 2