View Full Version : Managing CRON and max_pages

02-18-2004, 09:13 AM
We added a new feature to manage from Phpdig admin area:
-crontab list
-the max number of pages indexed per site .

Setting the field "Days" with a value > 0 you set the number of days cron must wait befor reindex a page.
The php script write a text file named "phpdig_cron". Here is an example:
0 0 1-31/1 * * /path/to/phpdig_cron
0 0 1-31/1 * * php -f /path/to/spider.php http://www1.smfn.unical.it/
0 0 1-31/3 * * php -f /path/to/spider.php http://www.miriane.it/
0 0 1-31/4 * * php -f /path/to/spider.php http://www.vinsoft.it/

As you can see, in the first line crontab reload the list daily, so you can apdate it from the admin area and wait 1 night to see your sites updated automatically.
Then you have the list of the site you want to automatically reindex.
The site www.miriane.it is reindexed every 3 days, www.vinsoft.it every 4 days.

If some of you is interested to the source code we can post it here (ask me or Jygius)

You can see a demo HERE (http://www.fis.unical.it/~phpdig/)

Enter in admin using default user/password
click on Statistics -> Pagespersite


02-24-2004, 01:26 AM
A patched version of Phpdig 1.8.0 with the feature described in this thred is online.

You can find it in the phpdig (http://www.vinsoft.it/phpdig/) page of my website.

Please, report bugs, comments and suggestions :D

I hope Charter will include our mods in the next official release of Phpdig.