PDA

View Full Version : WAMP - Not spidering


totobeloeil
04-10-2006, 05:54 AM
Hello,

I should need some help because the spidering doesn't work and I really don't find what to do.

The configuration is Windows 2000 Professional / Apache V2.0.55 / PHP V5.1.2 / MySQL V5.0.19 / phpDig V1.8.9-RC1.

When spidering, the first thing I've got is :

Spidering in progress... [Stop spider]
SITE : http://localhost/
Exclude paths :
- @NONE@
Wait...


Then I get a window telling that Apache has generated errors and will be closed by Windows.

If I stop spider.php, I can see that the site has been created into the tables (sites and site_page), but there is nothing into the other tables.

It is the same whatever I try to crawl : localhost, external site, single page, ...

If somebody has got an idea ...

Here are the main parameters of my config files :

php.ini
allow_url_fopen = On
; cgi.force_redirect = 1
doc_root =
extension_dir = "./ext/"
extension=php_mbstring.dll
extension=php_mcrypt.dll
extension=php_mysqli.dll
extension=php_mysql.dll
;open_basedir =
register_globals = Off
safe_mode = Off
sql.safe_mode = Off


httpd.conf
DocumentRoot "H:/Serveur/Apache2/htdocs"
ServerName localhost:80
<Directory "H:/Serveur/Apache2/htdocs">
SymLinksifOwnerMatch ExecCGI MultiViews
Options Indexes FollowSymLinks
AllowOverride None
Order allow,deny
Allow from all
</Directory>

The following lines where added at the end of httpd.conf :
LoadModule php5_module "H:/Serveur/PHP/php5apache2.dll"
AddType application/x-httpd-php .php
# Configure le chemin vers le fichier php.ini
PHPIniDir "C:/WINNT/"


config.php
define('ABSOLUTE_SCRIPT_PATH','H:/Serveur/Apache2/htdocs/phpDig');
define('ALLOW_SUBDIRECTORIES',false);
define('CRON_ENABLE',true);
define('FTP_ENABLE',0);
define('LIMIT_DAYS',0);
define('LIMIT_TO_DIRECTORY',false);
define('PHPDIG_ADM_AUTH','1');
define('PHPDIG_DEFAULT_INDEX',false);
define('PHPDIG_IN_DOMAIN',true);
define('USE_RENICE_COMMAND','0');

In config.php, *_LIMIT and FORBIDDEN where unchanged.

connect.php
define('PHPDIG_DB_PREFIX','');
define('PHPDIG_DB_HOST','localhost');
define('PHPDIG_DB_USER','*****');
define('PHPDIG_DB_PASS','*****');
define('PHPDIG_DB_NAME','phpdig');

totobeloeil
04-12-2006, 12:04 AM
I finally installed phpDig V1.8.8 .
Now, spidering is working on localhost.
It seems to me that it doesn't spider the whole.
But as there are many posts about this ...

fire59
04-18-2006, 08:30 AM
I'm having the same problem where 1.8.8 will only index the home page or the page that I tell it to. It doesn't go beyond that page. Can you provide the link to this discussion?

fire59
04-18-2006, 08:56 AM
I'm running phpDig 1.8.8, MySQL 4.0.24, PHP 5.05, Apache 2.0.54 on Kubuntu Linux.