PhpDig.net - View Single Post - phpdig seems to guess some urls and spider it

manute · 04-28-2004, 03:59 AM

hi!

that's not what i wrote. these urls do exist, but they aren't linked anywhere. and yes, i'm sure about that.

here's an example:

http://www.fussball24.de/fussball/115/frauen -> original url linked on the site, spidered well, all right

http://www.fussball24.de/fussball/115 -> url guessed by phpdig, does exist but is exactly the same like the one above.

any ideas?

04-28-2004, 03:59 AM	#4
manute Orange Mole Join Date: Oct 2003 Location: hamburg, germany Posts: 52	hi! that's not what i wrote. these urls do exist, but they aren't linked anywhere. and yes, i'm sure about that. here's an example: http://www.fussball24.de/fussball/115/frauen -> original url linked on the site, spidered well, all right http://www.fussball24.de/fussball/115 -> url guessed by phpdig, does exist but is exactly the same like the one above. any ideas?