PhpDig.net - View Single Post

WebSpider · 02-07-2005, 01:10 AM

Is the Depth limit of 20 a script limitation? a resource limitation? some sort of loop avoidance?

I ask because I tried to spider a directory where each new page of results is considered a new level, and there are categories with more than 20 pages.

Can we break this limit somehow?

Thanks!

02-07-2005, 01:10 AM	#1
WebSpider Green Mole Join Date: Feb 2005 Posts: 16	Break the depth limit of 20? Is the Depth limit of 20 a script limitation? a resource limitation? some sort of loop avoidance? I ask because I tried to spider a directory where each new page of results is considered a new level, and there are categories with more than 20 pages. Can we break this limit somehow? Thanks!