[vinyl-junkie]

Originally Posted by Jad

what to do when I have to crawl sites with different encoding ?

The only thing you can do is change the encoding each time you want to crawl a different site. It's a pain, I know, but it will work for you.