PDA

View Full Version : one domain


xibalba
03-11-2004, 07:33 PM
Does anyone know how to make PhPDig only crawl one domain? I initially started PHPDig like such

%php -f spider.php example.com

and now the crawler has more than 300 hosts in the database. I only want it to crawl example.com and store the information on that one paticular domain.

Charter
03-12-2004, 10:18 AM
Hi. What version of PhpDig are you running? With version 1.8.0 it should crawl just the one domain, assuming the tempspider table is empty between runs. To empty this table, just click the delete button from the admin panel without selecting a site.