alivin70
02-18-2004, 09:13 AM
We added a new feature to manage from Phpdig admin area:
-crontab list
-the max number of pages indexed per site .
Setting the field "Days" with a value > 0 you set the number of days cron must wait befor reindex a page.
The php script write a text file named "phpdig_cron". Here is an example:
0 0 1-31/1 * * /path/to/phpdig_cron
0 0 1-31/1 * * php -f /path/to/spider.php http://www1.smfn.unical.it/
0 0 1-31/3 * * php -f /path/to/spider.php http://www.miriane.it/
0 0 1-31/4 * * php -f /path/to/spider.php http://www.vinsoft.it/
As you can see, in the first line crontab reload the list daily, so you can apdate it from the admin area and wait 1 night to see your sites updated automatically.
Then you have the list of the site you want to automatically reindex.
The site www.miriane.it is reindexed every 3 days, www.vinsoft.it every 4 days.
If some of you is interested to the source code we can post it here (ask me or Jygius)
You can see a demo HERE (http://www.fis.unical.it/~phpdig/)
Enter in admin using default user/password
click on Statistics -> Pagespersite
Enjoy
Alivin70
-crontab list
-the max number of pages indexed per site .
Setting the field "Days" with a value > 0 you set the number of days cron must wait befor reindex a page.
The php script write a text file named "phpdig_cron". Here is an example:
0 0 1-31/1 * * /path/to/phpdig_cron
0 0 1-31/1 * * php -f /path/to/spider.php http://www1.smfn.unical.it/
0 0 1-31/3 * * php -f /path/to/spider.php http://www.miriane.it/
0 0 1-31/4 * * php -f /path/to/spider.php http://www.vinsoft.it/
As you can see, in the first line crontab reload the list daily, so you can apdate it from the admin area and wait 1 night to see your sites updated automatically.
Then you have the list of the site you want to automatically reindex.
The site www.miriane.it is reindexed every 3 days, www.vinsoft.it every 4 days.
If some of you is interested to the source code we can post it here (ask me or Jygius)
You can see a demo HERE (http://www.fis.unical.it/~phpdig/)
Enter in admin using default user/password
click on Statistics -> Pagespersite
Enjoy
Alivin70