ASHM
03-06-2006, 04:40 PM
Hi, I just want to exclude certain paths from the spider and couldn't find anything in the documentation.
I came to the forum and signed up in the hope that the answer would appear but the only results were filled with hidden replies by admins.
Surely this is a base function of PHPDig and its method shouldn't be excluded from those whose organisations are too cheap to pay the $5 registration fee.
I'd hoped it might be as simple as adding a - before the URLs but this doesn't seem to work. I know I managed to do this before but for the life of me can't rediscover how to do it through the admin or config file.
For example I want to spider domain.org.au but exclude the following paths and URL matches:
- ashm.org.au/admin
- ashm.org.au/module.php?id=
Could someone who's not an admin please reply to this or send me an email?
Thanks in advance!
I came to the forum and signed up in the hope that the answer would appear but the only results were filled with hidden replies by admins.
Surely this is a base function of PHPDig and its method shouldn't be excluded from those whose organisations are too cheap to pay the $5 registration fee.
I'd hoped it might be as simple as adding a - before the URLs but this doesn't seem to work. I know I managed to do this before but for the life of me can't rediscover how to do it through the admin or config file.
For example I want to spider domain.org.au but exclude the following paths and URL matches:
- ashm.org.au/admin
- ashm.org.au/module.php?id=
Could someone who's not an admin please reply to this or send me an email?
Thanks in advance!