not spidering all pages (too many links on page?)
I have trouble getting all my pages spidered.
I don't think it has to do with levels, since it does find some pages at deeper levels. However it doesn't spider all links on pages.
I was thinking it might have to do with the LINKS_MAX_LIMIT being 20.
In config.php I've tried changing LINKS_MAX_LIMIT to 100, but that doesn't seem to make any difference.
Any idea?
|