[futureweb]

Hello,

I tried to use a simple txt file to be able to have a link list that should be spidered, for some reason, that is not working. with all or forceall it works with the already known domains, but not the ones within list.txt, as I understood you use following command:
php -f [PHPDIG_DIR]/admin/spider.php list.txt

the .txt file looks like:


http://site1.com
http://site2.com
http://site3.com

but another question, is it possible to have all links within a page spidered, also of external domains, but only external domains that we specify?

like site1.com has links within site1.com but also a link to site2.com and site100.com.

I want that the links to site2.com are spidered, but not site100.com

thanks
patrick