View Single Post
Old 10-30-2005, 06:01 AM   #1
Trallis
Green Mole
 
Join Date: Oct 2005
Posts: 3
Problem Spidering

I cannot index any sites with my install of phpDig. I have v1.8.8 RC1 on a windows box and apache. Directory permissions are already set correctly and I verified that allow_url_fopen is enabled.

I am trying to index: http://www.noland.com/noland/index.php

When the spider starts, it seems to pull the parent directory www.noland.com (which is unavailable to the web as it redirects to www.noland.com/noland)

When I try to spider an external site such as www.mtslink.com it will not work either.

Here is the output that I get:

Spidering in progress... [Stop spider]

--------------------------------------------------------------------------------
SITE : http://www.noland.com/
Exclude paths :
- Admin/
- auctiondata/
- calendar/
- cgi-local/
- enoland/
- itemmaint/
- mail/
- msds/
- nol****nline/
- nolandtest/
- obis/
- Orders/
- phpinc/
- squidalizer/
- Stylesheets/
- test/
- webmail/
- webalizer/
- squidalizer-detail/

Wait...
1:http://www.noland.com/noland/
(time : 00:00:05)
No link in temporary table

--------------------------------------------------------------------------------

links found : 1
http://www.noland.com/noland/
Optimizing tables...
Indexing complete !
Trallis is offline   Reply With Quote