PDA

View Full Version : Server Log Oddity


vinyl-junkie
07-29-2004, 08:34 AM
Not a problem per se, but since it's phpdig related I suppose this is the best place for it.

I've noticed several entries in my server error log lately similar to the following:[error] [client 209.237.238.178] File does not exist: /path/to/search/text_content/7358.txt That IP address resolves to crawl28-public.alexa.com, so the question is - Why would the Alexa spider be trying to crawl content from my phpdig text_content directory?

Charter
07-29-2004, 10:17 AM
Hi. If directory listings were enabled at some point, then Alexa could have found the text_content directory so the bot is coming back to reindex.

> whois 209.237.238.178
United Layer, Inc. UNITEDLAYER-1 (NET-209-237-224-0-1)
209.237.224.0 - 209.237.255.255
Alexa Internet ALEXA-INTERNET (NET-209-237-237-0-1)
209.237.237.0 - 209.237.238.255

Otherwise it could be someone just trying to find a text file, who knows why as it's just text. Nothing in the PhpDig itself creates links directly to that directory.