PhpDig.net

Go Back   PhpDig.net > PhpDig Forums > Troubleshooting

Reply
 
Thread Tools
Old 04-14-2006, 01:38 AM   #1
patrick@online-
Green Mole
 
Join Date: Apr 2006
Posts: 3
Not indexing pages, keywords, etc..

Hi,

I've installed phpdig, and although it seems to go out crawling, all I ever
end up with are a database full of domains but no content, pages, or
anything else...

What gives?

If I use the search function, nothing ever shows there either, which is
because there's nothing to show, of course.

How do we get ahold of an older "working" version of this script? I have
tried the archive links, but they all lead to version 1.8.8.

Thanks,
Patrick
patrick@online- is offline   Reply With Quote
Old 04-14-2006, 02:34 AM   #2
totobeloeil
Green Mole
 
Join Date: Apr 2006
Location: France
Posts: 12
No spidering and robot_functions.php

Perhaps you have to change a value in admin/robot_functions.php :
replace $pu['port'] = '';
by $pu['port'] = 0;
as explained in this thread :

http://www.phpdig.net/forum/showthread.php?t=2350

I recently installed phpDig V1.8.8 and it's working
totobeloeil is offline   Reply With Quote
Old 04-14-2006, 02:50 AM   #3
patrick@online-
Green Mole
 
Join Date: Apr 2006
Posts: 3
Thanks for the reply,

I already tried that one, but still is not working properly.

Thanks anyway,
Patrick
patrick@online- is offline   Reply With Quote
Old 04-14-2006, 03:11 AM   #4
totobeloeil
Green Mole
 
Join Date: Apr 2006
Location: France
Posts: 12
Perhaps this link could help you :

http://www.phpdig.net/forum/showthread.php?p=9414

If you modify php.ini, perhaps you have to restart the machine before it works.
Could be there are several php.ini files.
What is your configuration (windows / linux, etc...) ?
What are you trying to spider (localhost or external) ?
Did spider.php create anything in the sites table or not ?
totobeloeil is offline   Reply With Quote
Old 04-14-2006, 01:12 PM   #5
patrick@online-
Green Mole
 
Join Date: Apr 2006
Posts: 3
Hi,

Thanks again, but I'm on a Linux server with php.ini set per the install
instructions.

>What is your configuration (windows / linux, etc...) ?
Linux- Actually, using CentOS,and RedHat9 (tried on two separate servers)
but same basic deal.

>What are you trying to spider (localhost or external) ?
External Sites - Basically link pages and directories.

>Did spider.php create anything in the sites table or not ?
Just the domain (http://www.whatever.com/) but that's it.

As I look through the database structure, I really do not see any tables
or rows that could possibly hold web page content anyway... I'm wondering
if it's even been added to this version or maybe I have a bad database
set up?.?.

It also looks as if it's a pretty common problem as I look through the forums,
and no one really seems to have a solid answer to this issue...

I think I'll come back in a few months and see how the next release
comes along.

Thanks for the help,
Patrick
patrick@online- is offline   Reply With Quote
Old 04-15-2006, 02:10 AM   #6
totobeloeil
Green Mole
 
Join Date: Apr 2006
Location: France
Posts: 12
Hi,
It seems that http://www.whatever.com/
has moved to http://www.funny.com/
With phpDig V1.8.8, I can't spider the first site, but the second yes.
totobeloeil is offline   Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
keywords missing after indexing 123av Troubleshooting 2 10-21-2004 08:28 AM
excluding keywords from indexing Fking How-to Forum 1 10-05-2004 05:43 PM
Indexing finds all pages, but doesn't index all keywords arakune Troubleshooting 2 08-25-2004 05:18 PM
Reduce duplicates in keywords table through more intelligent indexing jerrywin5 Mod Requests 1 04-20-2004 08:06 AM
Junk in keywords table - Indexing PDF Bege External Binaries 2 04-09-2004 07:15 AM


All times are GMT -8. The time now is 11:37 AM.


Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.