Node.js encoding not UTF-8

Question

I read html page encoded win1251. But I cant render it, because it shows me bad encoded symbols. with utf8 this code works fine. How can I read and show not utf8? Thanks

var charset = require('charset');
var iconv = require('iconv-lite');
var router = express.Router();


// accept POST request on the homepage
router.post('/', function (req, res) {

  request(req.body.url, function (error, response, body) {

    var result = [];
    if (error || response.statusCode != 200) {
        console.log(error);

    } else {
        console.log(charset(response.headers, body));
        var enc = charset(response.headers, body);
        if (enc != 'utf-8') {

            body = iconv.decode(body, 'win1251');
            console.log(body);
        }
        var $ = cheerio.load(body);

        //get title
        result.push("Title-> " + $("title").text());

mscdex · Accepted Answer · 2015-04-14 05:27:47Z

2

If you set encoding: null in your request() options, body will be a Buffer instead of a UTF-8 string. This will allow you to correctly convert the encoding to UTF-8.

Example:

request({url: req.body.url, encoding: null}, function (error, response, body) {

If the encoding of the body ends up being UTF-8, you can simply just do:

body = body.toString('utf8');

answered Apr 14, 2015 at 5:27

mscdex

107k15 gold badges201 silver badges159 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

EK. · Accepted Answer · 2015-04-14 07:44:59Z

0

If someone gets this problem too. I did instead of (which is good too)

body = body.toString('utf8');

My code

var iconv = require('iconv-lite');
.......................

body = iconv.decode(body, 'win1251');

answered Apr 14, 2015 at 7:44

EK.

3,0569 gold badges39 silver badges50 bronze badges

Collectives™ on Stack Overflow

Node.js encoding not UTF-8

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related