Don't know if this helps or not (should have mentioned it earlier), but when I spidered this site it seemed to take a really long time (about 3 or 4 minutes), and we're talking about a site with around 20 pages total. With my Unix site, I could spider a few hundred pages in the same length of time.
Also, just for grins I decided to update the spidering just now and got this error:
Quote:
HTTP/1.1 502 Gateway Error Server: Microsoft-IIS/5.0 Date: Sun, 15 Feb 2004 02:18:08 GMT Connection: close Content-Length: 186 Content-Type: text/html
CGI Timeout
The specified CGI application exceeded the allowed time for processing. The server has deleted the process.
|