I am having exactly the same issue. PhpDig works perfectly on my local machine and my local machine can spider my external domain. However when I install phpdig in my web hosting it just searches the first page BUT nothing is written to the database under keywords.
Oh, and I could see an answer to the problem in the two threads named above.
Thanks