command line link list not working
 

Hello,

I tried to use a simple txt file to be able to have a link list that should be spidered, for some reason, that is not working. with all or forceall it works with the already known domains, but not the ones within list.txt, as I understood you use following command:
php -f [PHPDIG_DIR]/admin/spider.php list.txt

the .txt file looks like:


http://site1.com
http://site2.com
http://site3.com

but another question, is it possible to have all links within a page spidered, also of external domains, but only external domains that we specify?

like site1.com has links within site1.com but also a link to site2.com and site100.com.

I want that the links to site2.com are spidered, but not site100.com

thanks
patrick

> ...link list that should be spidered, for some reason, that is not working...

Are you using verison 1.8.7 or 1.8.8 RC1? If you pipe the output to a log file, what does the log file contain?

> ...possible to have all links within a page spidered...

Set LIMIT_TO_DIRECTORY to false in the config file.

> ...external domains, but only external domains that we specify...

Use the admin panel text box or a cron with text file.