Is there any way to spider Multiple URL's instead of all the pages in a single URL?
I need to index subject specific web sites, the top or index page of each site only. If phpDig will do this, please tell me how to do it or better yet, direct me to an existing thread with this info.
THANKS!