View Single Post
Old 10-23-2006, 11:29 PM   #1
mikiwiki
Green Mole
 
Join Date: Apr 2006
Posts: 4
Long Time Spidering Crashes

I am spidering a huge web with a big amount of data. Very often, the web spidering (launched from admin) ends unexpectedly ("Page not found") 1, 2 or 3 hours later... Is it normal? Can a phpdig process, for example, work 24h continously?

Thanks
mikiwiki is offline   Reply With Quote