Thanks for the help Charter. On a tangent, is it possible to setup phpDig in a distributed fashion?
Say I want to crawl a huge domain,
www.example.com with multiple machines crawling that domain. Is there a way currently to set phpdig up in this style?