PDA

View Full Version : WAMP - Spidering became crazy


totobeloeil
04-09-2006, 04:46 AM
Hello,

The configuration first :
Windows 2000 Professional / Apache 2.0.55 / PHP 5.1.2 / MySQL 5.0.19 / localhost
As I couldn't create a site inside the sites table by the spider.php, I tried different tricks before I understand that spider.php was the normal way to do it.
So, I finally made the 'dirty change' proposed by Sealless
http://www.phpdig.net/forum/showthread.php?t=2350
and spider.php created the site into the sites and site-page tables. OK.
But then, the spidering became crazy because the site was locked.
I had to stop spidering.
I think perhaps it is because the site has just been created, but as I am quite web-unexperienced ...
This happens with localhost as well (!) as with external sites.
In spider.php, I modified the print-command (line 261) to check it was the origin of the problem, and it is.

The problem doesn't appear when I try to spider one of the sites which are already in the sites table. The spidering doesn't work in this case, but I think my parameters are not all right ...
Anyway, perhaps a how-to-forum question ...

totobeloeil
04-09-2006, 06:30 AM
As I didn't find any 'update_db_to_1_8_9_rc1.sql' file, I considered that there was no update to do.
But the DB-type was InnoDB, instead of MyISAM.
So it couldn't work ...
Now, Spidering is not crazy anymore. But I become to be ... :bang:
Perhaps Apache parameters are not all right ... Any Idea ?

totobeloeil
04-12-2006, 03:58 AM
I'm confused :
In phpDig V1.8.9, I didn't understand that there were a crash while spidering :

Une exception d'application s'est produite :
App : (pid=1980)
Lorsque : 11/04/2006 @ 09:56:12.591
Numéro d'exception : c0000005 (violation d'accès)

Perhaps is it a problem similar to the one which was reported by GunMuse (but on linux) :

http://www.phpdig.net/forum/showthread.php?t=2378
(http://www.phpdig.net/forum/showthread.php?t=2378)
I tried to debug but finally installed phpDig V1.8.8 .