View Single Post
Old 06-14-2004, 11:27 PM   #1
nathansc
Green Mole
 
Join Date: Jun 2004
Posts: 3
Unhappy spidering problem

I'm installing phpdig and I really like it... but I know I'm doing something wrong here. When I goto the admin interface, and enter the URL I want to spider, it is only indexing the index page and no further. I am using 5 or 6 for the search depth.

First: it only seems to be spidering the index. It doesn't index the pages that are linked off of the index.

Second: I wonder is the problem because my site is a subdirectory itself. http://depts.washington.edu/vei/

Third: My site has several dynamically generated, php, pages (a course catalog.) The spider is defintely not indexing these. These pages are about three links down from the index.

Almost all the pages on my site are at least partially dynamic. They all have a dynamic nav bar which lives in a different directory.

Thanks for any help you can give.

Nathan
__________________
Nathan
nathansc is offline   Reply With Quote