barik
10-23-2004, 06:07 PM
I can't figure out the criteria which spider.php uses to decide whether to follow a link. Please take a look at:
http://www.barik.net/archive/
Every link is found except for all of the months! (Jan, Feb, Mar, etc.)! Can anyone shed some light on why this is? Did I forget to turn on an option? Does spider.php not look at links if they are formed a particular way?
Any help is appreciated,
Titus Barik
http://www.barik.net/archive/
Every link is found except for all of the months! (Jan, Feb, Mar, etc.)! Can anyone shed some light on why this is? Did I forget to turn on an option? Does spider.php not look at links if they are formed a particular way?
Any help is appreciated,
Titus Barik