Go Back > PhpDig Forums > Troubleshooting

Thread Tools
Old 10-25-2006, 10:46 AM   #1
Green Mole
Join Date: Oct 2006
Posts: 1
Mod-rewrite = spidering / URL problems


Couldn't quite get to the bottom of this via a search, but it seems that others have been there ...

Our rewrite rule renders .../index.php?section=4 to .../r-section-4

Spidering is getting confused and not getting into sub-pages, and search results often include a trailing slash (e.g., ".../r-section-4/").

The good news is that all of our rewritten url's begin with "r-", so I should be able to capture these, were I clever! The bad news is that I ain't that clever.

Would be happy to be pointed to an applicable thread, etc.

jcnorris is offline   Reply With Quote
Old 10-26-2006, 09:38 AM   #2
Head Mole
Charter's Avatar
Join Date: May 2003
Posts: 2,539
Untested but find in the phpdigRewriteUrl function:
// phpdig 1.8.9 rc1

    $retour['path'] = mb_ereg_replace('(.*[^/])/?$','\1/',mb_ereg_replace('^/(.*)','\1',mb_ereg_replace("/+","/",$path)));

// phpdig 1.8.8

    $retour['path'] = ereg_replace('(.*[^/])/?$','\1/',ereg_replace('^/(.*)','\1',ereg_replace("/+","/",$path)));
And replace with the following:
// phpdig 1.8.9 rc1

    $retour['path'] = mb_ereg_replace('^/(.*)','\1',mb_ereg_replace("/+","/",$path));

// phpdig 1.8.8

    $retour['path'] = ereg_replace('^/(.*)','\1',ereg_replace("/+","/",$path));
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
Charter is offline   Reply With Quote

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Not spidering mod rewritten pages wineo Troubleshooting 1 02-22-2006 07:53 PM
Spidering problems Dave A Troubleshooting 8 08-21-2005 07:46 AM
Looking for Url submission mod for 1.8.7 Gam-Man Mod Requests 0 06-04-2005 01:52 PM
Problem with spidering with url tex list :-( claudiomet Troubleshooting 1 09-07-2004 03:32 PM
Problems with URL parsing apdejong Troubleshooting 6 11-20-2003 02:35 AM

All times are GMT -8. The time now is 06:09 AM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.