PDA

View Full Version : phpdig add some underscores to URLs


cjones
12-10-2004, 03:09 AM
In phpdig when i type a address to dig it for some reason it adds a underscore to it for example http://waix.bur.st becomes http://waix.bur.st____/. I recenlty applied that update that changes the spider.php and robotfunctions.php so it can index external domains. What is going on here?

Thanks,
cjones

cjones
12-10-2004, 04:34 AM
it ok fixed, but now phpdig cant even find links in http://waix.bur.st, even though there are 100 links
it returns
SITE : http://waix.bur.st/
Exclude paths :
- @NONE@
No link in temporary table

--------------------------------------------------------------------------------

links found : 0
...Was recently indexed
Optimizing tables...
Indexing complete !

wats wrong?

Charter
12-10-2004, 12:35 PM
>> I recenlty applied that update that changes the spider.php and robotfunctions.php so it can index external domains.

What update was that? With PhpDig 1.8.4 the only changes needed are those in this (http://www.phpdig.net/forum/showthread.php?t=1573) thread. If you want to go external, then look for the following in the robot_functions.php file:

// be careful setting this to true as indexing
// could take a very, VeRy, VERY looooong time
// return true;

and set PHPDIG_IN_DOMAIN to true in the config file.

cjones
12-10-2004, 03:25 PM
it was that files.zip that was released, anyway do you know why it can index http://proud.id.au/waix and not http://waix.bur.st?

Should do a complete fresh install?

Charter
12-10-2004, 03:30 PM
Note that attachments and posts have been made over numerous versions of PhpDig, so such things may not be relevant to the current version. Make sure to check this (http://www.phpdig.net/forum/showthread.php?t=1573) thread periodically for v.1.8.4 updates, and try a fresh install and see what happens.

cjones
12-12-2004, 07:58 PM
ok, i upgraded to v1.8.5 and i looked in robot_functions.php and i cant find the PHPDIG_IN_DOMAIN line, does this mean phpdig automatically does it?

fresh install cleared the underscore errors and indexing errors, its just that external domain line i cant find

byw, the new version is great

Charter
12-12-2004, 08:00 PM
Check the config file.

cjones
12-13-2004, 05:36 AM
thanks, found it and fixed

sorry about hogging your time but i have 1 more problem.

i get this at the end of spidering

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 246

--------------------------------------------------------------------------------
SITE : http://waix.waia.asn.au/
Exclude paths :
- @NONE@

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 356

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 371
Duplicate of an existing document
1:http://waix.waia.asn.au/lg
(time : 00:00:06)

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 356

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 371
Duplicate of an existing document
2:http://waix.waia.asn.au/
(time : 00:00:11)

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 356
No link in temporary table

i kept the connect.php file when i upgraded to v1.8.5 because me and my hoster have a real hassle with the mysql server because he knows the settings that i dont. i know i can read the file but its much easier this way

bug or stuffup by me or mysql fault?

thank you very much

Charter
12-13-2004, 07:13 AM
Update the database tables 1.8.3 -> 1.8.4 -> 1.8.5.

cjones
12-13-2004, 03:15 PM
do you mean i have to downgrade to 1.8.4, updatedb, install 1.8.5 and then updatedb?

vinyl-junkie
12-13-2004, 06:45 PM
If you run the sql updates for 1.8.4 and 1.8.5, that's all you'll have to do to your database itself. The rest of the upgrade is just replacing the phpdig files. No downgrading necessary to accomplish that.

Hope this helps.