I've got similar problems. I'm trying to index several sites. Sites that have literally thousands of links.
one in particular I was able to index with a different search script (that I didn't like nearly as much) and received over 20,000 links (then I stopped it after I realized I liked this one better).
Anyway, the most I can get out of that same site with phpdig is 357 pages.
|