PDA

View Full Version : not indexing some links


drywall
09-01-2004, 12:33 PM
I've got Apache configured to some URL rewriting, so links that would be like dir/page.php?variable=value can be rewritten much more simply as dir//value.

Unfortunately, (I suspect due to the double-/) phpdig is not acknowledging these links and following them, leaving portions of the site un-indexed.

Is there something I can tweak in phpdig somewhere to have it index these URLs instead of ignoring them? Or am I going to need to change my Apache rewrite to accomodate phpDig? (which I'm reluctant but ultimately wiling to do if I have to).

Charter
09-07-2004, 03:27 PM
Hi. Try looking in the phpdigRewriteUrl function.

drywall
09-08-2004, 01:19 PM
Thanks for telling me where to look. Unfortunately, though I have a tiny bit of familiarity with regular expressions, my competenance isn't such that I can decipher the wizardry going on in phpdigRewriteUrl. What am I looking for and how would I modify it to play nice with my double-slash URLs?

Charter
09-11-2004, 06:21 AM
The below takes more than one slash and replaces them with one slash. It shows up a couple of times in the phpdigRewriteUrl function so try removing it from the code.

ereg_replace("/+","/",$path)

drywall
09-13-2004, 07:06 AM
Aha. I feel dumb for not spotting that one, it's pretty blatant. Thank you.

Unfortunately, neither modifying its behavior (I changed "/+" to "//+") nor removing it entirely (in the two places it appears) worked: phpdig still isn't finding those links.

Your help has been dead-on and seems like it should have fixed things, but...