Phpdig find a lot of 404 errors
 

Hello,

First thanks for phpdig whitch is a wonderfull tool :)

I use phpdig 1.8.8 on a url rewrited site with about 8000 pages on Debian Sarge/apache/php/mysql.

My pb :

When i use the command line with php on a shell, phpdig spiders my site but find a lot of 404 errors after level1, I use xenu to verify 404 errors and brokens links and my site has no 404 errors and links broken....

phpdig says :

XDoublon avec un document existant
20:http://www.mysite.com/annonces/liste-83-0.html
(temps : 00:00:34)
+ + + + + + +
niveau 1...
XDoublon avec un document existant
21:http://www.mysite.com/404.php
(temps : 00:00:38)
+
XDoublon avec un document existant
22:http://www.mysite.com/404.php
(temps : 00:00:44)
+
XDoublon avec un document existant
23:http://www.mysite.com/404.php
(temps : 00:00:49)
+
XDoublon avec un document existant
24:http://www.mysite.com/404.php

and after that always 404 error. In my apache logs :

[Sat Dec 10 16:39:25 2005] [error] [client 192.168.0.1] File does not exist: /var/www/html/mydir/annonces
[Sat Dec 10 16:39:27 2005] [error] [client 192.168.0.1] File does not exist: /var/www/html/mydir/annonces
[Sat Dec 10 16:39:27 2005] [error] [client 192.168.0.1] File does not exist: /var/www/html/mydir/annonces

something is wrong, but I don't know what :confused:

If you could help me thanks...

Well nobody can help me please ?

mYself I would delete the indexed content from the website, clean the index, clean the common words and then re index the website again, or you could open the admin panel and just reindex from the root area again, this may clear the problem for you.

If not check out my profile and send me the URL by email and I will index it and we can compare the results.

Heaps of regards
Dave A

Hello

Thanks for your help DaveA :santa:

I have done all what you said, but it is still the same

The site is not accessible from the internet right now, I am just waiting to make it working...

I have modified my .htaccess file and for 404 errors it is better, but with the apache log : File does not exist: /var/www/html/mydir/annonces
there is still a problem : phpdig search url with the path of my site and not with the url, I think there is a bug with phpdig... :no: