|
Hi Pat, thank you for the reply!
My case is in fact much easier, since the /portalnode/ path sould be excluded altogether from ANY robot indexing, thus my robots.txt looks like:
User-agent: *
Disallow: /portalnode/
Nevertheless, phpdig hangs in eactly that directory.
did I miss something?
Andreas
|