Cyrillic character in the URL !?
 

Hi,

I have URL with some cyrillic words

http://localhost/dir/link.php?query=áÃ*ãèëîïõ

Spider doesn't follow the links with Cyrillic character.


Any ideas?

Hi. There are a couple of regular expressions in this post that would need to be modified to allow for such characters. Maybe use the $phpdig_words_chars variable in the character class definitions.