I just downloaded phpDig 1.8.5 and installed it, and am having some troubles getting it to spider my site.
I had installed ver 1.6.2 and had it working well before, but I decided to start over as if it were a new install, as my databases are pretty small. I downloaded 1.8.5 into a directory on my server at /var/www/coreinitiative/htdocs/search. I created a new phpDig DB in MySQL called 'phpdig-ci' and a MySQL user 'phpdig-ci-user' and gave it a password and privilidges over the DB. I chown -R the directories text_content/, include/ and admin/temp/ to the Apache user and group. I edited include/config.php to change the admin password and made ABSOLUTE_SCRIPT_PATH equal '/var/www/coreinitiative/htdocs/search'.
Running admin/install.php seems to work fine, and doesn't give me any errors. The tables are created.
I can access admin/index.php and enter the URI of my site,
http://www.coreinitiative.org. It seems to correctly find and read the index page, but doesn't find any links. It only finds one page.
Running the spider from the command line gives:
Code:
www:/var/www/coreinitiative/htdocs/search# php4 -f admin/spider.php http://www.coreinitiative.org
3499: old priority 0, new priority 18
Spidering in progress...
-----------------------------
SITE : http://www.coreinitiative.org/
Exclude paths :
- @NONE@
XDuplicate of an existing document
1:http://www.coreinitiative.org/
(time : 00:00:06)
No link in temporary table
links found : 1
Optimizing tables...
Indexing complete !
www:/var/www/coreinitiative/htdocs/search#
Any suggestions on what I'm doing wrong? My problems seem similar to other posting here that talk about not spidering all of a site.
Thanks for your help and suggestions.
-Kevin