View Full Version : Url resembles news:

01-26-2004, 05:58 AM
Just came across a very unlikely bug, but thought I'd mention it.
I have been indexing a few sites to test things out, but there is one site that really does not work ok (there might be others, but I have only come across this one)

The url:

seems to hit a filter for links to news: ,and the url is not indexed.

I realize that this is a bit of a strange url (I do not make the site so do not blame me) , but perhaps it is a good idea to filter Url's that begin with "news: and not news: to make sure the news: part is the protocol and not a part of the url.


01-26-2004, 08:34 AM
Hi. Perhaps try editing the phpdigRewriteUrl function in the robot_functions.php file and remove the news piece from the following code:

if (eregi("[/]?mailto:|[/]?javascript:|[/]?news:",$eval)) {
return -1;