View Single Post
Old 12-21-2003, 01:50 AM   #3
ultradna
Green Mole
 
Join Date: Dec 2003
Posts: 6
Hello,

I'm using a Linux server with Apache httpd 1.3.27 and PHP version 4.3.0 without root access - so I'm not able to edit the php.ini file.

And everything has to do with safe mode is in this configuration :
( first value is local and second is master )

safe_mode "Off" "Off"
safe_mode_exec_dir "/usr/phpbin/" " /usr/phpbin/"
safe_mode_gid "Off" "Off"
safe_mode_include_dir "no value" "no value"

When the sipder is working too long, then I get :

Fatal error: Maximum execution time of 30 seconds exceeded in /xxx/xxx/xxx/admin/robot_functions.php on line 988

But I don't understand when php starts to count the timeout, because this are the last URLs that are spidered before timeout :

124:http://www.jdshfjsdhfljsdhflsdlf.cc/something.htm
(Zeit : 00:01:51)

125:http://www.jdshfjsdhfljsdhflsdlf.cc/something2.htm
(Zeit : 00:01:52)

126:http://www.jdshfjsdhfljsdhflsdlf.cc/something3.htm
(Zeit : 00:01:52)

So ... there are 1:52 mins !! not 30 sec.

Is there any way, I read it here (bit with no answer), that the spider is spidering - pausing - and the continues with spidering so that it doesn't get the timeout?

Thanx
ultradna is offline   Reply With Quote