vorbian
09-29-2004, 03:13 PM
How would I go about restricting the phpdig spider from indexing a directory.
I have a directory named calendar and inside that directroy are php files that will generate an infinite amount of pages and links. I would like the spider to exclude this directory.
Thanks in advance,
-Vorbian
I have a directory named calendar and inside that directroy are php files that will generate an infinite amount of pages and links. I would like the spider to exclude this directory.
Thanks in advance,
-Vorbian