PDA

View Full Version : Dynamic page indexing


hame22
05-06-2005, 07:21 AM
Iv successfully installed phpdig onto my web server.

Iv set up htaccess to make use of the mod_rewrite which writes my dynamic urls to a standard format

/activities/resource1.html rather than /activities/page.php?product_id=1

I have a link in my index.html page to the rewritten url

when i spider index.htm all standard pages are spidered but the modified dynamic url isnt.

Does anyone have any ideas as to why this has not happened?

thanks

alex

hame22
05-06-2005, 07:36 AM
I think i have found out why, the dynamic pages I wanted to spider were PHP pages that generated XML. I have since spidered a dynamic php page with no xml content.

Does anybody know why the page with xml content was not spidered and how I can get this to happen??

thanks all

Charter
05-10-2005, 10:07 AM
Do the XML pages send a mime-type of application/xhtml+xml? If so, then PhpDig doesn't understand the files, so it doesn't index them. If you want to index application/xhtml+xml mime-types, then you may find this (http://www.phpdig.net/forum/showthread.php?t=398) thread useful.