|
> ...link list that should be spidered, for some reason, that is not working...
Are you using verison 1.8.7 or 1.8.8 RC1? If you pipe the output to a log file, what does the log file contain?
> ...possible to have all links within a page spidered...
Set LIMIT_TO_DIRECTORY to false in the config file.
> ...external domains, but only external domains that we specify...
Use the admin panel text box or a cron with text file.
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
|