vinyl-junkie
07-29-2004, 08:34 AM
Not a problem per se, but since it's phpdig related I suppose this is the best place for it.
I've noticed several entries in my server error log lately similar to the following:[error] [client 209.237.238.178] File does not exist: /path/to/search/text_content/7358.txt That IP address resolves to crawl28-public.alexa.com, so the question is - Why would the Alexa spider be trying to crawl content from my phpdig text_content directory?
I've noticed several entries in my server error log lately similar to the following:[error] [client 209.237.238.178] File does not exist: /path/to/search/text_content/7358.txt That IP address resolves to crawl28-public.alexa.com, so the question is - Why would the Alexa spider be trying to crawl content from my phpdig text_content directory?