PDA

View Full Version : How can I make phpdig spider faster


jakeres
11-02-2004, 01:36 AM
Hi there....

I've installed phpdig and tested with my local site....and it takes almost 5 minutes to scan all 10 pages from site.... WHY?


I've looked over the code ...and see how it does a lot of tests before getting the actual html content....Does fsockopen take so long ?!?

Can you tell me how to speep up things a little bit?!

Thanks.

Kim Steinhaug
11-29-2004, 11:05 AM
I am wondering on the exact same thing. I havnt had time to study the code to much, since Im kinda "depending" on someone else which handles the project to look into this.... umm.. :)

Well, there might be reasons why the digging is so annoyingly slow - running the dig on a brand new computer with loads of CPU power doesnt really seem to speed it up either...

Any feedback on this would be wonderful, some explernations would also make me feel better since I would then be happy with those, hehe.

Well, okidoki.