Just someting a little further. If I change to the phpdig/admin directory and run the spider from there using
PHP Code:
cd public_html/search/admin/
/usr/bin/php4 -f spider.php http://www.mysite.com
it seems to work OK - so I am trying to work out why calling it using a full path would be any different?