I don't know if it's wishful thinking or not, but this forum is the place to voice this request...
Is there any way that PhpDig could be modified in such a way as to speed up spidering? I know a while back there was a forked spidering script posted here which was later removed because it wasn't developed enough. Anything like that would be a great modification to PhpDig, and I am sure that the entire PhpDig community would agree.
Like I said, I don't know if this is possible, but this is the mod requests forum and that's my request.