PhpDig.net - View Single Post - Can't get PHPDig to index an htaccess protected site

mlerch@mac.com · 02-20-2004, 05:53 PM

Hi Charter,

Thanks for your answer. I will look for the customization stuff in the forum. Not a problem.

Regarding the spidering of the htaccess protected site. I created a demo user and password for the spidering. This user can access the site perfectly when accessing it through a browser. When I let it run in PhpDig it won't even go to the spider.php page... the browser says.... "... loading page" but that's it. It just hangs there. I let it run for like 20-30 minutes, but the spider.php page never loaded.

Don't know if this helps in any way. It's really strange.

Mr. L

02-20-2004, 05:53 PM	#5
mlerch@mac.com Green Mole Join Date: Feb 2004 Location: North Las Vegas, Nevada Posts: 18	Hi Charter, Thanks for your answer. I will look for the customization stuff in the forum. Not a problem. Regarding the spidering of the htaccess protected site. I created a demo user and password for the spidering. This user can access the site perfectly when accessing it through a browser. When I let it run in PhpDig it won't even go to the spider.php page... the browser says.... "... loading page" but that's it. It just hangs there. I let it run for like 20-30 minutes, but the spider.php page never loaded. Don't know if this helps in any way. It's really strange. Mr. L