PhpDig.net

PhpDig.net (http://www.phpdig.net/forum/index.php)
-   IPs, SEs, & UAs (http://www.phpdig.net/forum/forumdisplay.php?f=35)
-   -   google update (http://www.phpdig.net/forum/showthread.php?t=616)

heiko 03-04-2004 11:29 PM

google update
 
hi,

does anyone know how often google comes by to reindex and how deep the crawlerfollowing the site...

I made a complete redesign of a site and still (a couple of weeks later) there are old pages which are found (even those, which declared in the robots.txt not to index) and stil a lot new pages (it is always the same page with ?productname=XY) are not indexed???

thanks..for comments
heiko

Charter 03-05-2004 09:01 AM

Hi. Google seems to do a major reindex once per month and seems to intermittently reindex certain pages during the month. Some robots don't like session IDs in query strings so it may be best to keep XY in the query string to a minimum length. Some useful information can be found here including info on robot.txt files.

shinji 03-06-2004 06:34 AM

google visits my phpdig 3 times a day :D

without giving any variables like 'reindex' ;)

vinyl-junkie 03-06-2004 09:21 PM

Quote:

Originally posted by shinji
google visits my phpdig 3 times a day :D

without giving any variables like 'reindex' ;)

Google visits my site pretty often like that too. However, if you look at what really changes in their index, Charter is right. They seem to only make major changes about once a month.

I'd give it actually one to two months before I expected too much to change with Google's index when you've done a major overhaul to your site.

bloodjelly 04-17-2004 04:10 PM

I get the ~ one per month deep sweep by google on my art site - with up to 5-10 bots at a time. Every day they do a light scan, though, updating the front page in their cache. I heard that if you update your site more frequently and add new content consistently, Google will 'learn' to come by more often.


All times are GMT -8. The time now is 06:12 PM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.