PhpDig.net

Go Back   PhpDig.net > PhpDig Forums > Troubleshooting

Reply
 
Thread Tools
Old 12-10-2004, 03:09 AM   #1
cjones
Green Mole
 
Join Date: Dec 2004
Posts: 13
phpdig add some underscores to URLs

In phpdig when i type a address to dig it for some reason it adds a underscore to it for example http://waix.bur.st becomes http://waix.bur.st____/. I recenlty applied that update that changes the spider.php and robotfunctions.php so it can index external domains. What is going on here?

Thanks,
cjones
cjones is offline   Reply With Quote
Old 12-10-2004, 04:34 AM   #2
cjones
Green Mole
 
Join Date: Dec 2004
Posts: 13
it ok fixed, but now phpdig cant even find links in http://waix.bur.st, even though there are 100 links
it returns
SITE : http://waix.bur.st/
Exclude paths :
- @NONE@
No link in temporary table

--------------------------------------------------------------------------------

links found : 0
...Was recently indexed
Optimizing tables...
Indexing complete !

wats wrong?
cjones is offline   Reply With Quote
Old 12-10-2004, 12:35 PM   #3
Charter
Head Mole
 
Charter's Avatar
 
Join Date: May 2003
Posts: 2,539
>> I recenlty applied that update that changes the spider.php and robotfunctions.php so it can index external domains.

What update was that? With PhpDig 1.8.4 the only changes needed are those in this thread. If you want to go external, then look for the following in the robot_functions.php file:
PHP Code:
// be careful setting this to true as indexing
// could take a very, VeRy, VERY looooong time
//       return true; 
and set PHPDIG_IN_DOMAIN to true in the config file.
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
Charter is offline   Reply With Quote
Old 12-10-2004, 03:25 PM   #4
cjones
Green Mole
 
Join Date: Dec 2004
Posts: 13
it was that files.zip that was released, anyway do you know why it can index http://proud.id.au/waix and not http://waix.bur.st?

Should do a complete fresh install?
cjones is offline   Reply With Quote
Old 12-10-2004, 03:30 PM   #5
Charter
Head Mole
 
Charter's Avatar
 
Join Date: May 2003
Posts: 2,539
Note that attachments and posts have been made over numerous versions of PhpDig, so such things may not be relevant to the current version. Make sure to check this thread periodically for v.1.8.4 updates, and try a fresh install and see what happens.
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
Charter is offline   Reply With Quote
Old 12-12-2004, 07:58 PM   #6
cjones
Green Mole
 
Join Date: Dec 2004
Posts: 13
ok, i upgraded to v1.8.5 and i looked in robot_functions.php and i cant find the PHPDIG_IN_DOMAIN line, does this mean phpdig automatically does it?

fresh install cleared the underscore errors and indexing errors, its just that external domain line i cant find

byw, the new version is great
cjones is offline   Reply With Quote
Old 12-12-2004, 08:00 PM   #7
Charter
Head Mole
 
Charter's Avatar
 
Join Date: May 2003
Posts: 2,539
Check the config file.
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
Charter is offline   Reply With Quote
Old 12-13-2004, 05:36 AM   #8
cjones
Green Mole
 
Join Date: Dec 2004
Posts: 13
thanks, found it and fixed

sorry about hogging your time but i have 1 more problem.

i get this at the end of spidering

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 246

--------------------------------------------------------------------------------
SITE : http://waix.waia.asn.au/
Exclude paths :
- @NONE@

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 356

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 371
Duplicate of an existing document
1:http://waix.waia.asn.au/lg
(time : 00:00:06)

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 356

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 371
Duplicate of an existing document
2:http://waix.waia.asn.au/
(time : 00:00:11)

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 356
No link in temporary table

i kept the connect.php file when i upgraded to v1.8.5 because me and my hoster have a real hassle with the mysql server because he knows the settings that i dont. i know i can read the file but its much easier this way

bug or stuffup by me or mysql fault?

thank you very much
cjones is offline   Reply With Quote
Old 12-13-2004, 07:13 AM   #9
Charter
Head Mole
 
Charter's Avatar
 
Join Date: May 2003
Posts: 2,539
Update the database tables 1.8.3 -> 1.8.4 -> 1.8.5.
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
Charter is offline   Reply With Quote
Old 12-13-2004, 03:15 PM   #10
cjones
Green Mole
 
Join Date: Dec 2004
Posts: 13
do you mean i have to downgrade to 1.8.4, updatedb, install 1.8.5 and then updatedb?
cjones is offline   Reply With Quote
Old 12-13-2004, 06:45 PM   #11
vinyl-junkie
Purple Mole
 
Join Date: Jan 2004
Posts: 694
If you run the sql updates for 1.8.4 and 1.8.5, that's all you'll have to do to your database itself. The rest of the upgrade is just replacing the phpdig files. No downgrading necessary to accomplish that.

Hope this helps.
vinyl-junkie is offline   Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
I: PHPDIG can not index 2+ URLs.. ? PL_90 Script Installation 0 10-22-2007 07:51 AM
phpdig seems to guess some urls and spider it manute Troubleshooting 7 04-29-2004 01:49 AM
Add Url Script blueuniverse Mod Requests 4 03-01-2004 12:34 PM
PhpDig crop the URLs at ( gaam Troubleshooting 2 02-11-2004 04:32 AM
Points, underscores, ampersands and slashes renehaentjens Mod Requests 1 12-08-2003 01:00 PM


All times are GMT -8. The time now is 05:28 AM.


Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.