Quick update on this thread:
I have manage to force updates using this command from shell:
php -f path/spider.php forceall
As an estimate, it will take about 4 days to crawl my whole site.
I was thinking too, maybe I've been searching for a more complicated answer to my query.
Because I have "<meta name="Revisit-after" content="5 Days">" on all my web pages, would this prevent phpdig from spidering a second time from the browser admin interface?
Thanks,
Dale.
|