xibalba
03-11-2004, 06:33 PM
Does anyone know how to make PhPDig only crawl one domain? I initially started PHPDig like such
%php -f spider.php example.com
and now the crawler has more than 300 hosts in the database. I only want it to crawl example.com and store the information on that one paticular domain.
%php -f spider.php example.com
and now the crawler has more than 300 hosts in the database. I only want it to crawl example.com and store the information on that one paticular domain.