Since it won't let me reply to this thread, here goes here... ;-)
http://www.phpdig.net/forum/showthread.php?t=662
(I know that is an old thread, but I think people are still playing with the wrapper.php mod).
To answer some of the questions:
1. You should also comment out these two lines the beginning of this file:
//show_source("wrapper.php");
//exit;
2. You put wrapper.php in the admin directory.
3. You should log in to the command line (e.g. ssh or telnet) and then you cd to that directory:
cd /path-to-phpdig/admin/
4. Then you should run:
php -f wrapper.php
5. From the command line, this command will show you what is running:
screen -list
6. The current wrapper code calls for at most 6 spiders/threads going:
$threads = 6;
Obviously you can increase it, but I don't know how much improvement you'd get.
I've only been playing with this for a couple of days, but all in all, the whole phpdig package is pretty cool. The two things that I am looking at improving are:
1. Number of spiders, with multiple spiders, the speed increases. Has to be reliable though. So far it seems wrapper.php is doing ok in the reliability department. Where I saw people saying it re-queues sites, that could be fixed by having it check the date to re-spider...still looking into that to see if I see that issue...
2. Modularization. The main code isn't very encapsulated so it makes it more difficult to understand and modify without lots of side effects. ;-)
It is great to have this as an option, and hopefully it will keep getting improved. ;-)