Not indexing pages, keywords, etc..

[patrick@online-]

Hi,

I've installed phpdig, and although it seems to go out crawling, all I ever
end up with are a database full of domains but no content, pages, or
anything else...

What gives?

If I use the search function, nothing ever shows there either, which is
because there's nothing to show, of course.

How do we get ahold of an older "working" version of this script? I have
tried the archive links, but they all lead to version 1.8.8.

Thanks,
Patrick

[totobeloeil]

Perhaps you have to change a value in admin/robot_functions.php :
replace $pu['port'] = '';
by $pu['port'] = 0;
as explained in this thread :

http://www.phpdig.net/forum/showthread.php?t=2350
(http://www.phpdig.net/forum/showthread.php?t=2350)
I recently installed phpDig V1.8.8 and it's working

[patrick@online-]

Thanks for the reply,

I already tried that one, but still is not working properly.

Thanks anyway,
Patrick

[totobeloeil]

Perhaps this link could help you :

http://www.phpdig.net/forum/showthread.php?p=9414 (http://www.phpdig.net/forum/showthread.php?p=9414)
If you modify php.ini, perhaps you have to restart the machine before it works.
Could be there are several php.ini files.
What is your configuration (windows / linux, etc...) ?
What are you trying to spider (localhost or external) ?
Did spider.php create anything in the sites table or not ?

[patrick@online-]

Hi,

Thanks again, but I'm on a Linux server with php.ini set per the install
instructions.

>What is your configuration (windows / linux, etc...) ?
Linux- Actually, using CentOS,and RedHat9 (tried on two separate servers)
but same basic deal.

>What are you trying to spider (localhost or external) ?
External Sites - Basically link pages and directories.

>Did spider.php create anything in the sites table or not ?
Just the domain (http://www.whatever.com/) but that's it.

As I look through the database structure, I really do not see any tables
or rows that could possibly hold web page content anyway... I'm wondering
if it's even been added to this version or maybe I have a bad database
set up?.?.

It also looks as if it's a pretty common problem as I look through the forums,
and no one really seems to have a solid answer to this issue...

I think I'll come back in a few months and see how the next release
comes along.

Thanks for the help,
Patrick

[totobeloeil]

Hi,
It seems that http://www.whatever.com/
has moved to http://www.funny.com/
With phpDig V1.8.8, I can't spider the first site, but the second yes.