PDA

View Full Version : Search Depth using cron


hpg4815
10-02-2006, 08:49 AM
Hi,

I put together the command line string that I wish to call via crontab. I have first tried to exeute the job myself first at the prompt. No errors occur, and the spider.log is empty. I am wondering whats going on, and can only assume the I need to set the "search depth" and " links per" some where in the config script. Please respond if you have any info on this. I have been going throught the forums and havn't been able to find anthing. Which make me assume its somthing simple.

My setup:
/usr/bin/php -f /var/www/domain/search/admin/spider.php all /var/www/domain/search/list.txt > /var/www/domain/search/log/spider.log

everything has the right permissions

Thanks
-HIram

hpg4815
10-02-2006, 09:16 AM
A couple of more questions:

should I be able to spider in both shell and browser at the same time?
should I be able to run the a command line spider w/o cron?
should explicitly state to user browser or shell spidering?
What possible reasons would the spider.log file be empty?

Thanks again.

Hiram :yum: