Go Back > General Forums > IPs, SEs, & UAs

Thread Tools
Old 03-04-2004, 11:29 PM   #1
Green Mole
Join Date: Oct 2003
Location: germany
Posts: 10
google update


does anyone know how often google comes by to reindex and how deep the crawlerfollowing the site...

I made a complete redesign of a site and still (a couple of weeks later) there are old pages which are found (even those, which declared in the robots.txt not to index) and stil a lot new pages (it is always the same page with ?productname=XY) are not indexed???

thanks..for comments
heiko is offline   Reply With Quote
Old 03-05-2004, 09:01 AM   #2
Head Mole
Charter's Avatar
Join Date: May 2003
Posts: 2,539
Hi. Google seems to do a major reindex once per month and seems to intermittently reindex certain pages during the month. Some robots don't like session IDs in query strings so it may be best to keep XY in the query string to a minimum length. Some useful information can be found here including info on robot.txt files.
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
Charter is offline   Reply With Quote
Old 03-06-2004, 06:34 AM   #3
Green Mole
Join Date: Jan 2004
Location: Hamm/NRW/Germany
Posts: 26
google visits my phpdig 3 times a day

without giving any variables like 'reindex'
shinji is offline   Reply With Quote
Old 03-06-2004, 09:21 PM   #4
Purple Mole
Join Date: Jan 2004
Posts: 694
Originally posted by shinji
google visits my phpdig 3 times a day

without giving any variables like 'reindex'
Google visits my site pretty often like that too. However, if you look at what really changes in their index, Charter is right. They seem to only make major changes about once a month.

I'd give it actually one to two months before I expected too much to change with Google's index when you've done a major overhaul to your site.
vinyl-junkie is offline   Reply With Quote
Old 04-17-2004, 04:10 PM   #5
Purple Mole
Join Date: Dec 2003
Posts: 106
I get the ~ one per month deep sweep by google on my art site - with up to 5-10 bots at a time. Every day they do a light scan, though, updating the front page in their cache. I heard that if you update your site more frequently and add new content consistently, Google will 'learn' to come by more often.
bloodjelly is offline   Reply With Quote

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Google IP's mpnet IPs, SEs, & UAs 0 11-16-2004 11:15 PM
google like search engine sasa How-to Forum 3 09-10-2004 09:41 AM
Got a Google Toolbar? Charter The Mole Hole 3 08-28-2004 12:20 PM
Google API [Did you mean ***?] gooseman Mod Requests 0 04-24-2004 05:50 AM
a more google approach bthurlow Mod Submissions 4 10-08-2003 07:23 PM

All times are GMT -8. The time now is 02:34 AM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.