PDA

View Full Version : Index problem: missing files


gvelden
04-21-2004, 01:35 AM
Please help:

In six directories I have index.html as a starting page:
http://testsite/one-two.nl/
http://testsite/one-two.nl/inleiding/
http://testsite/one-two.nl/aanmelding/
http://testsite/one-two.nl/one/
http://testsite/one-two.nl/two/
http://testsite/one-two.nl/login/

Only two are not indexed:
http://testsite/one-two.nl/one/
http://testsite/one-two.nl/two/

The spider result is:

Spidering in progress...
HTTP/1.1 404 Not Found
HTTP/1.1 200 OK
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-Type: text/html
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: PHP/4.3.3
Set-Cookie: PHPSESSID=513dbb56e9ac48ff81a6a62d5df281d3; path=/
Date: Wed, 21 Apr 2004 09:22:14 GMT
Connection: close

HTTP/1.1 200 OK
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-Type: text/html
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: PHP/4.3.3
Set-Cookie: PHPSESSID=5735d0c33427847fa3e148e6a3fe2d98; path=/
Date: Wed, 21 Apr 2004 09:22:14 GMT
Connection: close

HTTP/1.1 404 Not Found

--------------------------------------------------------------------------------
SITE : http://testsite/
Exclude paths :
- @NONE@
HTTP/1.1 200 OK
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-Type: text/html
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: PHP/4.3.3
Set-Cookie: PHPSESSID=055c42ab35f5451962f4b4a29abf7171; path=/
Date: Wed, 21 Apr 2004 09:22:19 GMT
Connection: close

1:http://testsite/one-two.nl/
(time : 00:00:05)
HTTP/1.1 200 OK
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-Type: text/html
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: PHP/4.3.3
Set-Cookie: PHPSESSID=055c42ab35f5451962f4b4a29abf7171; path=/
Date: Wed, 21 Apr 2004 09:22:19 GMT
Connection: close

HTTP/1.1 301 Moved Permanently
Content-Length: 183
Content-Type: text/html
Location: http://testsite/one-two.nl/inleiding/
Server: Microsoft-IIS/6.0
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-Type: text/html
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: PHP/4.3.3
Set-Cookie: PHPSESSID=055c42ab35f5451962f4b4a29abf7171; path=/
Date: Wed, 21 Apr 2004 09:22:19 GMT
Connection: close

+ HTTP/1.1 200 OK
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-Type: text/html
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: PHP/4.3.3
Set-Cookie: PHPSESSID=055c42ab35f5451962f4b4a29abf7171; path=/
Date: Wed, 21 Apr 2004 09:22:19 GMT
Connection: close

HTTP/1.1 301 Moved Permanently
Content-Length: 184
Content-Type: text/html
Location: http://testsite/one-two.nl/aanmelding/
Server: Microsoft-IIS/6.0
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-Type: text/html
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: PHP/4.3.3
Set-Cookie: PHPSESSID=055c42ab35f5451962f4b4a29abf7171; path=/
Date: Wed, 21 Apr 2004 09:22:19 GMT
Connection: close

+ HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found
HTTP/1.1 200 OK
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-Type: text/html
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: PHP/4.3.3
Set-Cookie: PHPSESSID=055c42ab35f5451962f4b4a29abf7171; path=/
Date: Wed, 21 Apr 2004 09:22:19 GMT
Connection: close

HTTP/1.1 301 Moved Permanently
Content-Length: 179
Content-Type: text/html
Location: http://testsite/one-two.nl/login/
Server: Microsoft-IIS/6.0
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-Type: text/html
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: PHP/4.3.3
Set-Cookie: PHPSESSID=055c42ab35f5451962f4b4a29abf7171; path=/
Date: Wed, 21 Apr 2004 09:22:19 GMT
Connection: close

+
level 1...
HTTP/1.1 301 Moved Permanently
Content-Length: 183
Content-Type: text/html
Location: http://testsite/one-two.nl/inleiding/
Server: Microsoft-IIS/6.0
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-Type: text/html
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: PHP/4.3.3
Set-Cookie: PHPSESSID=055c42ab35f5451962f4b4a29abf7171; path=/
Date: Wed, 21 Apr 2004 09:22:29 GMT
Connection: close

2:http://testsite/one-two.nl/inleiding/
(time : 00:00:15)
HTTP/1.1 200 OK
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-Type: text/html
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: PHP/4.3.3
Set-Cookie: PHPSESSID=055c42ab35f5451962f4b4a29abf7171; path=/
Date: Wed, 21 Apr 2004 09:22:29 GMT
Connection: close

HTTP/1.1 301 Moved Permanently
Content-Length: 179
Content-Type: text/html
Location: http://testsite/one-two.nl/login/
Server: Microsoft-IIS/6.0
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-Type: text/html
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: PHP/4.3.3
Set-Cookie: PHPSESSID=055c42ab35f5451962f4b4a29abf7171; path=/
Date: Wed, 21 Apr 2004 09:22:29 GMT
Connection: close

+ HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found

HTTP/1.1 301 Moved Permanently
Content-Length: 184
Content-Type: text/html
Location: http://testsite/one-two.nl/aanmelding/
Server: Microsoft-IIS/6.0
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-Type: text/html
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: PHP/4.3.3
Set-Cookie: PHPSESSID=055c42ab35f5451962f4b4a29abf7171; path=/
Date: Wed, 21 Apr 2004 09:22:35 GMT
Connection: close

3:http://testsite/one-two.nl/aanmelding/
(time : 00:00:21)
HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found

HTTP/1.1 301 Moved Permanently
Content-Length: 179
Content-Type: text/html
Location: http://testsite/one-two.nl/login/
Server: Microsoft-IIS/6.0
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-Type: text/html
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: PHP/4.3.3
Set-Cookie: PHPSESSID=055c42ab35f5451962f4b4a29abf7171; path=/
Date: Wed, 21 Apr 2004 09:22:40 GMT
Connection: close

4:http://testsite/one-two.nl/login/
(time : 00:00:26)
HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found

level 2...
HTTP/1.1 301 Moved Permanently
Content-Length: 179
Content-Type: text/html
Location: http://testsite/one-two.nl/login/
Server: Microsoft-IIS/6.0
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-Type: text/html
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: PHP/4.3.3
Set-Cookie: PHPSESSID=055c42ab35f5451962f4b4a29abf7171; path=/
Date: Wed, 21 Apr 2004 09:22:50 GMT
Connection: close

Duplicate of an existing document
5:http://testsite/one-two.nl/login/
(time : 00:00:36)
HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found

No link in temporary table

--------------------------------------------------------------------------------

links found : 5
http://testsite/one-two.nl/
http://testsite/one-two.nl/inleiding/
http://testsite/one-two.nl/aanmelding/
http://testsite/one-two.nl/login/
http://testsite/one-two.nl/login/
Optimizing tables...
Indexing complete !
--------------------------------------------------------------------------------
[Back] to admin interface.

Charter
04-21-2004, 01:51 AM
Hi. Try this (http://www.phpdig.net/showthread.php?threadid=573) thread but be aware of this (http://www.phpdig.net/showthread.php?threadid=825) issue.

gvelden
04-21-2004, 04:54 AM
Thanks, but there are no redirects.