PhpDig.net - View Single Post

wineo · 02-22-2006, 07:38 PM

I have two sub domains for my site and phpdig spiders the one nicely (including mod rewrites). BUT, it is not spidering further than this new page on the other sub domain. It will not go deeper than the page http://www.wineography.com/wine_reviews.htm . Here is the report:

Code:

SITE : http://www.wineography.com/
Exclude paths :
- @NONE@
- cellar_wine_search.htm
- member_details.htm
Duplicate of an existing document
1:http://www.wineography.com/wine_reviews.htm
(time : 00:00:05)
No link in temporary table
links found : 1
http://www.wineography.com/wine_reviews.htm
Optimizing tables...
Indexing complete !

Any ideas on how to force it?!

02-22-2006, 07:38 PM	#1
wineo Green Mole Join Date: Feb 2006 Posts: 2	Not spidering mod rewritten pages I have two sub domains for my site and phpdig spiders the one nicely (including mod rewrites). BUT, it is not spidering further than this new page on the other sub domain. It will not go deeper than the page http://www.wineography.com/wine_reviews.htm . Here is the report: Code: SITE : http://www.wineography.com/ Exclude paths : - @NONE@ - cellar_wine_search.htm - member_details.htm Duplicate of an existing document 1:http://www.wineography.com/wine_reviews.htm (time : 00:00:05) No link in temporary table links found : 1 http://www.wineography.com/wine_reviews.htm Optimizing tables... Indexing complete ! Any ideas on how to force it?!