![]() |
I am using apache with windows.
|
I cant index my other site outside this server.. but i cannot index my localhost site past the first page..
:( Arghhh!! Mike |
Hmm i edited the hosts file, didnt seem to do much....
:( |
Hmm i edited the hosts file, didnt seem to do much....
:( Spidering in progress... HTTP/1.1 404 Not Found HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 00:07:23 GMT Server: Apache/1.3.29 (Win32) Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0 Expires: Mon, 26 Jul 1997 05:00:00 GMT Pragma: no-cache X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=6f5949a767040f2205d08dd10ef22138; expires=Tue, 30-Mar-2004 12:07:23 GMT; path=/ Set-Cookie: mosvisitor=1 Last-Modified: Tue, 30 Mar 2004 00:07:23 GMT Content-Type: text/html HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 00:07:23 GMT Server: Apache/1.3.29 (Win32) Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0 Expires: Mon, 26 Jul 1997 05:00:00 GMT Pragma: no-cache X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=7884431717962635e6edaf2e0de86858; expires=Tue, 30-Mar-2004 12:07:24 GMT; path=/ Set-Cookie: mosvisitor=1 Last-Modified: Tue, 30 Mar 2004 00:07:24 GMT Content-Type: text/html HTTP/1.1 404 Not Found -------------------------------------------------------------------------------- SITE : http://localhost/ Exclude paths : - @NONE@ HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 00:07:29 GMT Server: Apache/1.3.29 (Win32) Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0 Expires: Mon, 26 Jul 1997 05:00:00 GMT Pragma: no-cache X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=c6d9f45c7fee53937c186d09fe4aee4f; expires=Tue, 30-Mar-2004 12:07:29 GMT; path=/ Set-Cookie: mosvisitor=1 Last-Modified: Tue, 30 Mar 2004 00:07:29 GMT Content-Type: text/html 1:http://localhost/mambo/ (time : 00:00:08) No link in temporary table -------------------------------------------------------------------------------- links found : 1 http://localhost/mambo/ Optimizing tables... Indexing complete ! -------------------------------------------------------------------------------- [Back] to admin interface. |
Hi. Is there an index page in the mambo directory, or are you trying to index the directory content?
|
The content is created dynamically.. but the spider should spider the links.
|
Hi. It looks like PhpDig isn't recognizing any links from the page, but I'm not sure why. :( What happens if you enter the site from a different location? What gets indexed then?
|
Hi. Here's another thing to try.
In spider.php find: PHP Code:
PHP Code:
|
This is what I get:
Spidering in progress... HTTP/1.1 404 Not Found HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 16:42:54 GMT Server: Apache/1.3.29 (Win32) Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0 Expires: Mon, 26 Jul 1997 05:00:00 GMT Pragma: no-cache X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=2c5587f668574f2f226b5414477a485a; expires=Wed, 31-Mar-2004 04:42:54 GMT; path=/ Set-Cookie: mosvisitor=1 Last-Modified: Tue, 30 Mar 2004 16:42:54 GMT Content-Type: text/html HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 16:42:55 GMT Server: Apache/1.3.29 (Win32) Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0 Expires: Mon, 26 Jul 1997 05:00:00 GMT Pragma: no-cache X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=8fa61cdab071b4d8ae778fb946bab4aa; expires=Wed, 31-Mar-2004 04:42:55 GMT; path=/ Set-Cookie: mosvisitor=1 Last-Modified: Tue, 30 Mar 2004 16:42:55 GMT Content-Type: text/html HTTP/1.1 404 Not Found -------------------------------------------------------------------------------- SITE : http://webdev/ Exclude paths : - @NONE@ HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 16:43:01 GMT Server: Apache/1.3.29 (Win32) Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0 Expires: Mon, 26 Jul 1997 05:00:00 GMT Pragma: no-cache X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=58dd11d18fa05c61810a8b2e3a909c69; expires=Wed, 31-Mar-2004 04:43:01 GMT; path=/ Set-Cookie: mosvisitor=1 Last-Modified: Tue, 30 Mar 2004 16:43:01 GMT Content-Type: text/html 1:http://webdev/mambo/ (time : 00:00:08) No link in temporary table -------------------------------------------------------------------------------- links found : 1 http://webdev/mambo/ Optimizing tables... Indexing complete ! -------------------------------------------------------------------------------- [Back] to admin interface. |
Hmm it found 9 links.. not suire why only nine...
Spidering in progress... HTTP/1.1 404 Not Found HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:32 GMT Server: Apache/1.3.29 (Win32) Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0 Expires: Mon, 26 Jul 1997 05:00:00 GMT Pragma: no-cache X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=a87906bd18548ebbec948831c7b706c8; expires=Wed, 31-Mar-2004 05:08:32 GMT; path=/ Set-Cookie: mosvisitor=1 Last-Modified: Tue, 30 Mar 2004 17:08:32 GMT Content-Type: text/html HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:33 GMT Server: Apache/1.3.29 (Win32) Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0 Expires: Mon, 26 Jul 1997 05:00:00 GMT Pragma: no-cache X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=cd87162a1bfaa95bf6605be2f3fa3710; expires=Wed, 31-Mar-2004 05:08:33 GMT; path=/ Set-Cookie: mosvisitor=1 Last-Modified: Tue, 30 Mar 2004 17:08:33 GMT Content-Type: text/html HTTP/1.1 404 Not Found -------------------------------------------------------------------------------- SITE : http://webdev/ Exclude paths : - @NONE@ HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:38 GMT Server: Apache/1.3.29 (Win32) Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0 Expires: Mon, 26 Jul 1997 05:00:00 GMT Pragma: no-cache X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=1fc9a1d3dba9d95f30b4712b2de765fb; expires=Wed, 31-Mar-2004 05:08:38 GMT; path=/ Set-Cookie: mosvisitor=1 Last-Modified: Tue, 30 Mar 2004 17:08:38 GMT Content-Type: text/html 1:http://webdev/mambo/ (time : 00:00:08) HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:40 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Thu, 04 Mar 2004 19:57:09 GMT ETag: "0-1c12-40478a15" Accept-Ranges: bytes Content-Length: 7186 Content-Type: text/css HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:40 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Wed, 03 Mar 2004 22:41:40 GMT ETag: "0-3ff5-40465f24" Accept-Ranges: bytes Content-Length: 16373 Content-Type: text/css HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:40 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=304011bcdee116fbd36707af98a36ed9; expires=Wed, 31-Mar-2004 05:08:40 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html + HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:40 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=5d335223ad6d46ec0c4d11d0ca6bc08c; expires=Wed, 31-Mar-2004 05:08:40 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html + HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:40 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=844ff72a35830e71c4a898576ce94115; expires=Wed, 31-Mar-2004 05:08:40 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html + HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:40 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=4b39d7aa40ed6b36f57183ac9a0c9fc5; expires=Wed, 31-Mar-2004 05:08:40 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html + HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:40 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=0a672831a7d09ca2ed4fac184fc86b3c; expires=Wed, 31-Mar-2004 05:08:40 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html + New Url: http://www.200interchange.com/updates/update_02_04.html Old Url: http://webdev/ New Url: http://www.200interchange.com/updates/update_02_04.html Old Url: http://webdev/ New Url: http://www.mamboserver.com/mambo/ Old Url: http://webdev/ level 1... HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:50 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=b38bcc92d2841d104ff4a4776996cf8f; expires=Wed, 31-Mar-2004 05:08:50 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html 2:http://webdev/mambo/?option=content&...&id=1&Itemid=2 (time : 00:00:20) HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:52 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Thu, 04 Mar 2004 19:57:09 GMT ETag: "0-1c12-40478a15" Accept-Ranges: bytes Content-Length: 7186 Content-Type: text/css HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:52 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Wed, 03 Mar 2004 22:41:40 GMT ETag: "0-3ff5-40465f24" Accept-Ranges: bytes Content-Length: 16373 Content-Type: text/css HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:52 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=2b1e654f67940b3c193c7495dddbb495; expires=Wed, 31-Mar-2004 05:08:52 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html + HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:52 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=dd57a856984a8e9cec3ec69a66571390; expires=Wed, 31-Mar-2004 05:08:52 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html + HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:52 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=269c8d06d9a366ed545d64fe6c76ba7f; expires=Wed, 31-Mar-2004 05:08:52 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html + New Url: http://www.mamboserver.com/mambo/ Old Url: http://webdev/ HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:57 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=7740cc0f4f0e4c3a25571037d7998fcd; expires=Wed, 31-Mar-2004 05:08:57 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html Duplicate of an existing document 3:http://webdev/mambo/?option=content&...&id=3&Itemid=2 (time : 00:00:26) HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:59 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Thu, 04 Mar 2004 19:57:09 GMT ETag: "0-1c12-40478a15" Accept-Ranges: bytes Content-Length: 7186 Content-Type: text/css HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:08:59 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Wed, 03 Mar 2004 22:41:40 GMT ETag: "0-3ff5-40465f24" Accept-Ranges: bytes Content-Length: 16373 Content-Type: text/css New Url: http://www.mamboserver.com/mambo/ Old Url: http://webdev/ HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:04 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=fe19bc9dc3907b2069956fcc69a42974; expires=Wed, 31-Mar-2004 05:09:04 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html 4:http://webdev/mambo/?option=content&...w&id=4&Itemid= (time : 00:00:33) HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:05 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Thu, 04 Mar 2004 19:57:09 GMT ETag: "0-1c12-40478a15" Accept-Ranges: bytes Content-Length: 7186 Content-Type: text/css HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:05 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Wed, 03 Mar 2004 22:41:40 GMT ETag: "0-3ff5-40465f24" Accept-Ranges: bytes Content-Length: 16373 Content-Type: text/css New Url: http://www.mamboserver.com/mambo/ Old Url: http://webdev/ HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:10 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=47b90cb0be7fa8f6d576c9c36839f0af; expires=Wed, 31-Mar-2004 05:09:10 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html Duplicate of an existing document 5:http://webdev/mambo/?option=content&...w&id=5&Itemid= (time : 00:00:39) HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:11 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Thu, 04 Mar 2004 19:57:09 GMT ETag: "0-1c12-40478a15" Accept-Ranges: bytes Content-Length: 7186 Content-Type: text/css HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:11 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Wed, 03 Mar 2004 22:41:40 GMT ETag: "0-3ff5-40465f24" Accept-Ranges: bytes Content-Length: 16373 Content-Type: text/css New Url: http://www.mamboserver.com/mambo/ Old Url: http://webdev/ HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:16 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=6bf30fcd99967c95c10e2d02d4460b67; expires=Wed, 31-Mar-2004 05:09:16 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html Duplicate of an existing document 6:http://webdev/mambo/?option=content&...w&id=8&Itemid= (time : 00:00:45) HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:17 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Thu, 04 Mar 2004 19:57:09 GMT ETag: "0-1c12-40478a15" Accept-Ranges: bytes Content-Length: 7186 Content-Type: text/css HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:17 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Wed, 03 Mar 2004 22:41:40 GMT ETag: "0-3ff5-40465f24" Accept-Ranges: bytes Content-Length: 16373 Content-Type: text/css New Url: http://www.mamboserver.com/mambo/ Old Url: http://webdev/ level 2... HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:27 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=edad5cb9e902a30b0b0f6cef927309b9; expires=Wed, 31-Mar-2004 05:09:27 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html Duplicate of an existing document 7:http://webdev/mambo/?option=content&...w&id=7&Itemid= (time : 00:00:56) HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:28 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Thu, 04 Mar 2004 19:57:09 GMT ETag: "0-1c12-40478a15" Accept-Ranges: bytes Content-Length: 7186 Content-Type: text/css HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:28 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Wed, 03 Mar 2004 22:41:40 GMT ETag: "0-3ff5-40465f24" Accept-Ranges: bytes Content-Length: 16373 Content-Type: text/css New Url: http://www.mamboserver.com/mambo/ Old Url: http://webdev/ HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:33 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=f48dc83fa28d8c6ad50afe12fd5965d2; expires=Wed, 31-Mar-2004 05:09:33 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html 8:http://webdev/mambo/?option=com_regi...k=lostPassword (time : 00:01:02) HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:35 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Thu, 04 Mar 2004 19:57:09 GMT ETag: "0-1c12-40478a15" Accept-Ranges: bytes Content-Length: 7186 Content-Type: text/css HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:35 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Wed, 03 Mar 2004 22:41:40 GMT ETag: "0-3ff5-40465f24" Accept-Ranges: bytes Content-Length: 16373 Content-Type: text/css New Url: http://www.mamboserver.com/mambo/ Old Url: http://webdev/ HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:40 GMT Server: Apache/1.3.29 (Win32) X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=bf329c036413e5e4f1c8d10f8515abc2; expires=Wed, 31-Mar-2004 05:09:40 GMT; path=/ Set-Cookie: mosvisitor=1 Content-Type: text/html 9:http://webdev/mambo/?option=com_regi...&task=register (time : 00:01:08) HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:41 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Thu, 04 Mar 2004 19:57:09 GMT ETag: "0-1c12-40478a15" Accept-Ranges: bytes Content-Length: 7186 Content-Type: text/css HTTP/1.1 200 OK Date: Tue, 30 Mar 2004 17:09:41 GMT Server: Apache/1.3.29 (Win32) Last-Modified: Wed, 03 Mar 2004 22:41:40 GMT ETag: "0-3ff5-40465f24" Accept-Ranges: bytes Content-Length: 16373 Content-Type: text/css New Url: http://www.mamboserver.com/mambo/ Old Url: http://webdev/ No link in temporary table -------------------------------------------------------------------------------- links found : 9 http://webdev/mambo/ http://webdev/mambo/?option=content&...&id=1&Itemid=2 http://webdev/mambo/?option=content&...&id=3&Itemid=2 http://webdev/mambo/?option=content&...w&id=4&Itemid= http://webdev/mambo/?option=content&...w&id=5&Itemid= http://webdev/mambo/?option=content&...w&id=8&Itemid= http://webdev/mambo/?option=content&...w&id=7&Itemid= http://webdev/mambo/?option=com_regi...k=lostPassword http://webdev/mambo/?option=com_regi...&task=register Optimizing tables... Indexing complete ! -------------------------------------------------------------------------------- [Back] to admin interface. |
Hi. What did you do to get it to work?
|
I didnt do anything... it just worked..
Problem is, there are a lot more than just 9 links on that site.. any reason as to why it wouldnt index the whole thing? Mike |
Hi. Did you happen to restart Apache, and then it worked?
PhpDig is written to crawl links within one domain. If you want to crawl across domains, then check out this thread. |
Hmmm
It really isnt a domain, its a directory off my localhost... |
Hi. What changes did you make to your hosts file?
|
All times are GMT -8. The time now is 06:39 PM. |
Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.