PhpDig.net - View Single Post

mark · 11-26-2003, 11:44 AM

Hello, I'm using 1.6.4. I really like this package, it has been fun playing with it.

I installed PhpDig and spidered a few of my sites, then was busy with other things for a few days, when I came back I was pleasantly surprised to see many new domains had been spidered while I was away, even though I didn't recognize any of the new sites (in other words not sure where it found the links to them...?). After installing PhpDig, it seemed that all spidering must be manually initiated. Is the spider actually running automatically, and if so, what is the algorithm that it uses to branch out? Is this what I'm seeing when I see the "locked" sites in my domain list in the admin panel? Another question is what happens to all the links that the spider finds when spidering a site? Does it save them all and eventually come back and spider them as well?

11-26-2003, 11:44 AM	#7
mark Green Mole Join Date: Nov 2003 Posts: 5	Questions and Comments... Hello, I'm using 1.6.4. I really like this package, it has been fun playing with it. I installed PhpDig and spidered a few of my sites, then was busy with other things for a few days, when I came back I was pleasantly surprised to see many new domains had been spidered while I was away, even though I didn't recognize any of the new sites (in other words not sure where it found the links to them...?). After installing PhpDig, it seemed that all spidering must be manually initiated. Is the spider actually running automatically, and if so, what is the algorithm that it uses to branch out? Is this what I'm seeing when I see the "locked" sites in my domain list in the admin panel? Another question is what happens to all the links that the spider finds when spidering a site? Does it save them all and eventually come back and spider them as well?