View Single Post
Old 09-01-2004, 04:38 AM   #1
mirdin
Green Mole
 
Join Date: Apr 2004
Posts: 14
not spidering all pages (too many links on page?)

I have trouble getting all my pages spidered.

I don't think it has to do with levels, since it does find some pages at deeper levels. However it doesn't spider all links on pages.

I was thinking it might have to do with the LINKS_MAX_LIMIT being 20.

In config.php I've tried changing LINKS_MAX_LIMIT to 100, but that doesn't seem to make any difference.

Any idea?
mirdin is offline   Reply With Quote