Cyrillic character in the URL !?

[wertas]

Hi,

I have URL with some cyrillic words

http://localhost/dir/link.php?query=áÃ*ãèëîïõ

Spider doesn't follow the links with Cyrillic character.


Any ideas?

[Charter]

Hi. There are a couple of regular expressions in this (http://www.phpdig.net/showthread.php?postid=2141#post2141) post that would need to be modified to allow for such characters. Maybe use the $phpdig_words_chars variable in the character class definitions.