|
I think i have found out why, the dynamic pages I wanted to spider were PHP pages that generated XML. I have since spidered a dynamic php page with no xml content.
Does anybody know why the page with xml content was not spidered and how I can get this to happen??
thanks all
|