PDA

View Full Version : No spidering.....


Etienne
02-15-2006, 03:26 AM
Well, my english isn't perfect... :yum: I'' try to be clear, ok?

I've on my PC the following software installation:

Apache 1.3.3
mySql 3.23.53
php 4.3.7

I've installed phpdig without an problem so far....
I've a site with several pages (39) fitted in the same directory,
let's say [my directory]
Links to them are done via a javascript menu.

After the first spidering, I've only one page indexed.. strange!

I went trought documentation and didn't see anything to help me, I've tried to change several parameter but without any improvement!

The only solution I've found is a php script which read the [my directory] for php files and automatically generate hyperlinks.
It wasmore or less well running, I've now 23 pages!
Why not all ?

BUT, I'm sure it isn't the correct solution.

NEED some advices... thank in advance : :cool:

Another thing: is it any option planned to force phpdig to look the meta tags?

Thanks for all.....

Etienne
02-15-2006, 03:49 AM
Well, when setting the "search depth" to 10, I've now 41 pages....
Get now stuck with filename length more than 8 characters and duplicates...

Are they any option in the config file to set this option by default?

But still have the question about meta tags which aren't takein into consideration!

Etienne

Etienne
02-15-2006, 04:09 AM
Why do i have duplicated files ???
This is the outoput list:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
level 1...
2:http://jenreve/howtouse.php
(time : 00:00:04)

3:http://jenreve/admadd.php
(time : 00:00:05)

4:http://jenreve/admbklst.php
(time : 00:00:05)

5:http://jenreve/admin.php
(time : 00:00:06)

Duplicate of an existing document
6:http://jenreve/admlog.php
(time : 00:00:07)

7:http://jenreve/admmenu.php
(time : 00:00:08)

Duplicate of an existing document
8:http://jenreve/admupd.php
(time : 00:00:08)

Duplicate of an existing document
9:http://jenreve/admuser.php
(time : 00:00:09)

Duplicate of an existing document
10:http://jenreve/admvdlog.php
(time : 00:00:09)

11:http://jenreve/agenda.php
(time : 00:00:10)

12:http://jenreve/autordsc.php
(time : 00:00:11)

13:http://jenreve/catadd.php
(time : 00:00:12)

Duplicate of an existing document
14:http://jenreve/catupd.php
(time : 00:00:12)

15:http://jenreve/confgmnu.php
(time : 00:00:13)
16:http://jenreve/confirm.php
(time : 00:00:13)
17:http://jenreve/connect.php
(time : 00:00:13)

Duplicate of an existing document
18:http://jenreve/disconect.php
(time : 00:00:14)

19:http://jenreve/faq.php
(time : 00:00:15)

20:http://jenreve/favo.php
(time : 00:00:16)

Duplicate of an existing document
21:http://jenreve/index.php
(time : 00:00:16)

22:http://jenreve/menu.php
(time : 00:00:17)

23:http://jenreve/meta.php
(time : 00:00:18)

24:http://jenreve/news.php
(time : 00:00:18)

Duplicate of an existing document
25:http://jenreve/news4.0.php
(time : 00:00:19)

26:http://jenreve/phpbb.php
(time : 00:00:20)

Duplicate of an existing document
27:http://jenreve/phpbbadm.php
(time : 00:00:20)

Duplicate of an existing document
28:http://jenreve/phpdig.php
(time : 00:00:21)

Duplicate of an existing document
29:http://jenreve/questadd.php
(time : 00:00:22)

Duplicate of an existing document
30:http://jenreve/questdsp.php
(time : 00:00:23)

Duplicate of an existing document
31:http://jenreve/questgrer.php
(time : 00:00:23)

Duplicate of an existing document
32:http://jenreve/questupd.php
(time : 00:00:24)

33:http://jenreve/send.php
(time : 00:00:25)

34:http://jenreve/signon.php
(time : 00:00:25)
Duplicate of an existing document
35:http://jenreve/souscrre.php
(time : 00:00:26)

36:http://jenreve/spider.php
(time : 00:00:26)

37:http://jenreve/subscrbe.php
(time : 00:00:27)
38:http://jenreve/suggest.php
(time : 00:00:27)

39:http://jenreve/testwa.php
(time : 00:00:28)

40:http://jenreve/warning.php
(time : 00:00:29)

No link in temporary table

Thanks for your replies..... :cool:

ET