Propositions for phpDig 1.6.3

Iltud · 09-21-2003, 12:34 PM

IMHO only bugfixes should be included in the next minor release. New features can be included in a later release.
Do you think so ?

missing FLOAT l_time column in table logs. (See here )
- correction in /sql/init_db.sql
- something strange with /sql/update_db.sql in /admin/install.php at lines #60 and #86.
phpDigInclude tag is indexed (See here )
- correction in /admin/robot_functions.php, line #777
problems with Windows 2003 IIS 6. phpDig not compliant with RFC. (See here )
- correction in /admin/robot_functions.php, around lines #286-293 and #352-359
problem in indexing binary files (See here )
- correction in /admin/robot_functions.php, lines #681
In /informations/ update CHANGELOG, CREDITS and prehaps FILELIST.

Up to you... ?

Nicolas.

fzxdude · 09-26-2003, 04:51 AM

can we set it to only take a couple pages at a time from each domain in the list and then move on to the next. Premise being that when a couple pages from each domain are taken to move to the top of the list and take a couple more ?

that would make it so we aren't hammering sites too hard when we spider them

09-21-2003, 12:34 PM	#1
Iltud Green Mole Join Date: Sep 2003 Location: Brest - France Posts: 22	Propositions for phpDig 1.6.3 IMHO only bugfixes should be included in the next minor release. New features can be included in a later release. Do you think so ? missing FLOAT l_time column in table logs. (See here ) - correction in /sql/init_db.sql - something strange with /sql/update_db.sql in /admin/install.php at lines #60 and #86. phpDigInclude tag is indexed (See here ) - correction in /admin/robot_functions.php, line #777 problems with Windows 2003 IIS 6. phpDig not compliant with RFC. (See here ) - correction in /admin/robot_functions.php, around lines #286-293 and #352-359 problem in indexing binary files (See here ) - correction in /admin/robot_functions.php, lines #681 In /informations/ update CHANGELOG, CREDITS and prehaps FILELIST. Up to you... ? Nicolas. Last edited by Iltud; 09-21-2003 at 12:37 PM.

09-26-2003, 04:51 AM	#2
fzxdude Green Mole Join Date: Sep 2003 Posts: 4	when spidering via text file list of domains ... can we set it to only take a couple pages at a time from each domain in the list and then move on to the next. Premise being that when a couple pages from each domain are taken to move to the top of the list and take a couple more ? that would make it so we aren't hammering sites too hard when we spider them