Multiple crawler code error
 

Hi CHARTER,

I tried this code found on the forum :

http://www.phpdig.net/forum/showthread.php?t=662

I didn't change the fix because I don't know where are the lines to change.

I tried your code without the fix, and I have this error after the shell line command "php -f wrapper.php http://asite.com

[root@wpc1060 admin]# php -f wrapper.php http://www.asite.com
PHP Parse error: parse error, unexpected T_STRING in /home/httpd/vhosts/mysite.com/httpdocs/google/admin/wrapper.php on line 19
[root@wpc1060 admin]#


What can I do ?
My version is 1.8.8 RC1

Thank You ;)

Noël

The code in this thread is xibalba's code. Multiple spiders have not been written or tested by me, but you might get some additional ideas in this thread.

Hi CHARTER,

If I want to use xibalba's code, what do you think I have to change, in order it, to work with the new version of PHPDIG 1.8.8.RC1 ?

If I use your code :

array_unshift($list_sites,$site_datas);

Do you think it will also works in shell command ?

Thank You ;)

Noël

As I have not written or tested multiple spider code, I'm not sure of the changes needed or whether things would work from shell. The only things I can suggest are the ideas already mentioned. One thing you could try is running the following from shell and see what happens. Make a database backup beforehand just in case.