The thought was that, if you are trying to spider using multiple browsers, you don't want one browser adding domains to the list that the other browser is already indexing, or you might find yourself in a quasi-loop.
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
|