View Single Post
Old 07-05-2004, 10:47 AM   #25
Charter
Head Mole
 
Charter's Avatar
 
Join Date: May 2003
Posts: 2,539
Hi. When indexing http://www.napathon.net/ with search depth of ten and links_per of zero, and hand stopping after 100 links, below is the output. Do you not get this? Does anything show in your error logs?

Spidering in progress...

--------------------------------------------------------------------------------
SITE : http://www.napathon.net/
Exclude paths :
- test/
- phpdig181/
- BW-Original/
- Joe_and_Eddie/
1:http://www.napathon.net/
(time : 00:00:08)
+ + + + + + +
level 1...
2:http://www.napathon.net/miscmenu.php
(time : 00:00:20)
+ + + + + + + + + + + +
3:http://www.napathon.net/musicmenu.php
(time : 00:00:28)
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
4:http://www.napathon.net/SearchMenu.php
(time : 00:00:42)
Ok for http://search.napathon.net/search.php (site_id:469)
+
5:http://www.napathon.net/sitemap.php
(time : 00:00:50)

6:http://www.napathon.net/FAQ.php
(time : 00:00:57)

7:http://www.napathon.net/ContactMe.php
(time : 00:01:03)

8:http://www.napathon.net/Privacy.php
(time : 00:01:09)

level 2...
9:http://www.napathon.net/1219AshlandIntro.php
(time : 00:01:21)

10:http://www.napathon.net/1219AshlandSlideShow.php
(time : 00:01:27)

HTTP/1.1 404 Not Found - http://www.napathon.net/theimage/
See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation.
404s are either dead links or something looked like a link to PhpDig so PhpDig tried to crawl it.

HTTP/1.1 404 Not Found - http://www.napathon.net/theimage
See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation.
404s are either dead links or something looked like a link to PhpDig so PhpDig tried to crawl it.

11:http://www.napathon.net/BeeGeesMobile.php
(time : 00:01:34)

12:http://www.napathon.net/BoganReunion2003SlideShow.php
(time : 00:01:40)

HTTP/1.1 404 Not Found - http://www.napathon.net/theimage/
See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation.
404s are either dead links or something looked like a link to PhpDig so PhpDig tried to crawl it.

HTTP/1.1 404 Not Found - http://www.napathon.net/theimage
See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation.
404s are either dead links or something looked like a link to PhpDig so PhpDig tried to crawl it.

13:http://www.napathon.net/EstherEscortToHeaven.php
(time : 00:01:48)

14:http://www.napathon.net/MeAtWork.php
(time : 00:01:54)

15:http://www.napathon.net/RekkidRoom.php
(time : 00:02:00)

HTTP/1.1 404 Not Found - http://www.napathon.net/theimage/
See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation.
404s are either dead links or something looked like a link to PhpDig so PhpDig tried to crawl it.

HTTP/1.1 404 Not Found - http://www.napathon.net/theimage
See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation.
404s are either dead links or something looked like a link to PhpDig so PhpDig tried to crawl it.

16:http://www.napathon.net/WongFamily.php
(time : 00:02:08)

17:http://www.napathon.net/Wonglets.php
(time : 00:02:14)

18:http://www.napathon.net/BillsRecordsSlideShow.php
(time : 00:02:20)

HTTP/1.1 404 Not Found - http://www.napathon.net/theimage/
See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation.
404s are either dead links or something looked like a link to PhpDig so PhpDig tried to crawl it.

HTTP/1.1 404 Not Found - http://www.napathon.net/theimage
See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation.
404s are either dead links or something looked like a link to PhpDig so PhpDig tried to crawl it.

19:http://www.napathon.net/JohnnyGimbleSlideShow.php
(time : 00:02:27)

HTTP/1.1 404 Not Found - http://www.napathon.net/theimage/
See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation.
404s are either dead links or something looked like a link to PhpDig so PhpDig tried to crawl it.

HTTP/1.1 404 Not Found - http://www.napathon.net/theimage
See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation.
404s are either dead links or something looked like a link to PhpDig so PhpDig tried to crawl it.

20:http://www.napathon.net/CDTrusteeReview.php
(time : 00:02:33)

21:http://www.napathon.net/MusicIntro.php
(time : 00:02:39)

Meta Robots = NoIndex, or already indexed : No content indexed
22:http://www.napathon.net/MyCollection1.php
(time : 00:02:45)

23:http://www.napathon.net/NewArrivals1.php
(time : 00:02:52)
+ + + + +
24:http://www.napathon.net/BeeGees1.php
(time : 00:03:00)
+ + + + + + + + + + + + + + + + + + + + + + + + + + +
25:http://www.napathon.net/Blues1.php
(time : 00:03:11)
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
26:http://www.napathon.net/Corrs1.php
(time : 00:03:24)
+ + + + + + + + + + + + + + + + + + + + +
27:http://www.napathon.net/Country1.php
(time : 00:03:34)
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
28:http://www.napathon.net/EasyListening1.php
(time : 00:03:46)
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
29:http://www.napathon.net/Folk1.php
(time : 00:03:59)
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + +
30:http://www.napathon.net/Jazz1.php
(time : 00:04:10)
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
31:http://www.napathon.net/Miscellaneous1.php
(time : 00:04:23)
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + +
32:http://www.napathon.net/Reggae1.php
(time : 00:04:34)
+ + + + + + + + + + + + + + + + + + +
33:http://www.napathon.net/Rock1.php
(time : 00:04:44)
+ + + + + + + + + + + + + + + + + + + + + + + + + + +
34:http://www.napathon.net/SavageGarden2.php
(time : 00:04:55)
+ + + + + + + + + + + + + + + + + + + + + + +
35:http://www.napathon.net/TradeList.php
(time : 00:05:05)
+ + + + + + + + + + + + + + + + + +
36:http://www.napathon.net/WantList.php
(time : 00:05:14)

37:http://www.napathon.net/BadTrader.php
(time : 00:05:21)

38:http://www.napathon.net/LPtoCD.php
(time : 00:05:28)
+
39:http://www.napathon.net/ABeeGeesChristmas.php
(time : 00:05:34)

40:http://www.napathon.net/BeeGeeTastic.php
(time : 00:05:40)

41:http://www.napathon.net/KerrvilleEarlyYearsReview.php
(time : 00:05:48)

42:http://www.napathon.net/GottaGetReview.php
(time : 00:05:54)

43:http://www.napathon.net/ThreeBees.php
(time : 00:06:00)

44:http://www.napathon.net/BeeGees6.php
(time : 00:06:07)
+ + + + + + + + + + + + + + + + + + + + + +
45:http://www.napathon.net/WeLoveTheBeeGees.php
(time : 00:06:18)

46:http://www.napathon.net/BillsRecordsArticle.php
(time : 00:06:24)
+
47:http://www.napathon.net/IStartedAJoke.php
(time : 00:06:31)

48:http://www.napathon.net/JohnnyGimbleConcert.php
(time : 00:06:38)

49:http://www.napathon.net/CliveAnderson.php
(time : 00:06:44)

50:http://www.napathon.net/RustyWier.php
(time : 00:06:50)

51:http://www.napathon.net/InternetCollecting.php
(time : 00:06:58)

52:http://www.napathon.net/BWStevenson.php
(time : 00:07:05)

53:http://www.napathon.net/BWStevensonOnRhino.php
(time : 00:07:12)

54:http://www.napathon.net/BW-Lyrics.php
(time : 00:07:18)
+ + + + + + + + + +
55:http://www.napathon.net/BWStevenson/bw_intro.php
(time : 00:07:26)

56:http://www.napathon.net/BWStevenson/bw_page_1.php
(time : 00:07:32)

57:http://www.napathon.net/BWStevenson/bw_discography.php
(time : 00:07:39)

HTTP/1.1 404 Not Found - http://www.napathon.net/BWStevenson/top/
See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation.
404s are either dead links or something looked like a link to PhpDig so PhpDig tried to crawl it.

HTTP/1.1 404 Not Found - http://www.napathon.net/BWStevenson/top
See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation.
404s are either dead links or something looked like a link to PhpDig so PhpDig tried to crawl it.
+
58:http://www.napathon.net/BWStevenson/bw_memories.php
(time : 00:07:47)

59:http://www.napathon.net/BWStevenson/bw_tv.php
(time : 00:07:55)

Meta Robots = NoIndex, or already indexed : No content indexed
60:http://www.napathon.net/MusicDBSearch.php
(time : 00:08:01)

level 3...
Meta Robots = NoIndex, or already indexed : No content indexed
61:http://www.napathon.net/MusicDBSearch.php?BrowseArtistID=74
(time : 00:08:12)

62:http://www.napathon.net/AlbumID1552.php
(time : 00:08:18)

63:http://www.napathon.net/AlbumID1553.php
(time : 00:08:24)

Meta Robots = NoIndex, or already indexed : No content indexed
64:http://www.napathon.net/MusicDBSearch.php?BrowseArtistID=55
(time : 00:08:30)

65:http://www.napathon.net/AlbumID1557.php
(time : 00:08:36)

Meta Robots = NoIndex, or already indexed : No content indexed
66:http://www.napathon.net/MusicDBSearch.php?BrowseArtistID=338
(time : 00:08:43)

67:http://www.napathon.net/AlbumID1063.php
(time : 00:08:49)

Meta Robots = NoIndex, or already indexed : No content indexed
68:http://www.napathon.net/MusicDBSearch.php?BrowseArtistID=354
(time : 00:08:55)

69:http://www.napathon.net/AlbumID1153.php
(time : 00:09:01)

Meta Robots = NoIndex, or already indexed : No content indexed
70:http://www.napathon.net/MusicDBSearch.php?BrowseArtistID=39
(time : 00:09:07)

71:http://www.napathon.net/AlbumID42.php
(time : 00:09:13)

72:http://www.napathon.net/AlbumID43.php
(time : 00:09:20)

Meta Robots = NoIndex, or already indexed : No content indexed
73:http://www.napathon.net/MusicDBSearch.php?BrowseArtistID=350
(time : 00:09:26)

74:http://www.napathon.net/AlbumID1116.php
(time : 00:09:32)

Meta Robots = NoIndex, or already indexed : No content indexed
75:http://www.napathon.net/MusicDBSearch.php?BrowseArtistID=51
(time : 00:09:38)

76:http://www.napathon.net/AlbumID1546.php
(time : 00:09:44)

77:http://www.napathon.net/AlbumID1547.php
(time : 00:09:50)

78:http://www.napathon.net/AlbumID534.php
(time : 00:09:56)

79:http://www.napathon.net/AlbumID1456.php
(time : 00:10:03)

80:http://www.napathon.net/AlbumID80.php
(time : 00:10:09)

81:http://www.napathon.net/AlbumID82.php
(time : 00:10:15)

82:http://www.napathon.net/AlbumID91.php
(time : 00:10:22)

83:http://www.napathon.net/AlbumID537.php
(time : 00:10:28)

84:http://www.napathon.net/AlbumID83.php
(time : 00:10:34)

85:http://www.napathon.net/AlbumID1336.php
(time : 00:10:40)

86:http://www.napathon.net/AlbumID1077.php
(time : 00:10:47)

87:http://www.napathon.net/AlbumID92.php
(time : 00:10:53)

88:http://www.napathon.net/AlbumID802.php
(time : 00:11:00)

89:http://www.napathon.net/AlbumID93.php
(time : 00:11:06)

90:http://www.napathon.net/AlbumID826.php
(time : 00:11:13)

91:http://www.napathon.net/BeeGees2.php
(time : 00:11:19)
+ + + + + + + + + + + + +
92:http://www.napathon.net/BeeGees18.php
(time : 00:11:28)
+ + + + + + + + + + + + + +
Meta Robots = NoIndex, or already indexed : No content indexed
93:http://www.napathon.net/MusicDBSearch.php?BrowseArtistID=92
(time : 00:11:36)

94:http://www.napathon.net/AlbumID242.php
(time : 00:11:42)

Meta Robots = NoIndex, or already indexed : No content indexed
95:http://www.napathon.net/MusicDBSearch.php?BrowseArtistID=97
(time : 00:11:48)

96:http://www.napathon.net/AlbumID1296.php
(time : 00:11:55)

97:http://www.napathon.net/AlbumID253.php
(time : 00:12:01)

Meta Robots = NoIndex, or already indexed : No content indexed
98:http://www.napathon.net/MusicDBSearch.php?BrowseArtistID=119
(time : 00:12:07)

99:http://www.napathon.net/AlbumID297.php
(time : 00:12:13)

Meta Robots = NoIndex, or already indexed : No content indexed
100:http://www.napathon.net/MusicDBSearch.php?BrowseArtistID=400
(time : 00:12:19)
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
Charter is offline