PDA

View Full Version : google update


heiko
03-05-2004, 12:29 AM
hi,

does anyone know how often google comes by to reindex and how deep the crawlerfollowing the site...

I made a complete redesign of a site and still (a couple of weeks later) there are old pages which are found (even those, which declared in the robots.txt not to index) and stil a lot new pages (it is always the same page with ?productname=XY) are not indexed???

thanks..for comments
heiko

Charter
03-05-2004, 10:01 AM
Hi. Google seems to do a major reindex once per month and seems to intermittently reindex certain pages during the month. Some robots don't like session IDs in query strings so it may be best to keep XY in the query string to a minimum length. Some useful information can be found here (http://www.google.com/webmasters/faq.html) including info on robot.txt files.

shinji
03-06-2004, 07:34 AM
google visits my phpdig 3 times a day :D

without giving any variables like 'reindex' ;)

vinyl-junkie
03-06-2004, 10:21 PM
Originally posted by shinji
google visits my phpdig 3 times a day :D

without giving any variables like 'reindex' ;) Google visits my site pretty often like that too. However, if you look at what really changes in their index, Charter is right. They seem to only make major changes about once a month.

I'd give it actually one to two months before I expected too much to change with Google's index when you've done a major overhaul to your site.

bloodjelly
04-17-2004, 05:10 PM
I get the ~ one per month deep sweep by google on my art site - with up to 5-10 bots at a time. Every day they do a light scan, though, updating the front page in their cache. I heard that if you update your site more frequently and add new content consistently, Google will 'learn' to come by more often.