PHP CURL isn't processing encoded return data properly

Question

Im have some minor encoding issues. Im getting a json data string from here (try it yourself):

http://cdn.content.easports.com/fifa/fltOnlineAssets/C74DDF38-0B11-49b0-B199-2E2A11D1CC13/2014/fut/items/web/179899.json

The name in the data is shown like this

Ari SkÃºlason

How can I fetch this data with proper encoding so its Ari Skúlason?

I tried switching it to utf-8 like this in php

echo mb_convert_encoding($r,'ISO-8859-1','utf-8');

which got me closer, but its still not right

Ari Sk�lason

my php curl request:

$location = 'http://cdn.content.easports.com/fifa/fltOnlineAssets/C74DDF38-0B11-49b0-  B199-2E2A11D1CC13/2014/fut/items/web/179899.json';
$ch = curl_init($location);
curl_setopt($ch, CURLOPT_HEADER, false);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_HTTPHEADER, array(                                                                                                                                                        
'Accept: application/json'));
$r = curl_exec($ch);
curl_close($ch);
echo mb_detect_encoding($r);
$r = mb_convert_encoding($r,'ISO-8859-1','utf-8');

print_r($r);

do you have control on the url the your are CURLing with? you can change the encoding there — Netorica
– Netorica, Commented Sep 18, 2013 at 5:57
note that the second parameter of mb_convert_encoding is the to and the third is the from - so the line above converts from utf-8 to ISO-8859-1. See php.net/manual/en/function.mb-convert-encoding.php — Toby Beresford
– Toby Beresford, Commented Apr 27, 2024 at 21:17

Netorica · Accepted Answer · 2013-09-18 05:59:45Z

33

set another curl option for CURLOPT_ENCODING and set it to "" to ensure it will not return any garbage

   curl_setopt($ch, CURLOPT_ENCODING ,"");

answered Sep 18, 2013 at 5:59

Netorica

19.5k19 gold badges78 silver badges109 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

amir rasabeh · Accepted Answer · 2015-06-30 10:02:14Z

9

You Can use header

   header('Content-type: text/html; charset=UTF-8');

and after decode string

 $page = utf8_decode(curl_exec($ch));

It's worked for me

or

curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_ENCODING, 'UTF-8');
curl_setopt($ch,CURLOPT_USERAGENT,'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13');

after add this

$page = curl_exec($ch);
$dom = new DOMDocument('1.0', 'utf-8');
libxml_use_internal_errors(true);
@$dom->loadHTML(mb_convert_encoding($page, 'HTML-ENTITIES', 'UTF-8'));

edited Jun 30, 2015 at 10:02

answered Sep 4, 2014 at 6:45

amir rasabeh

4378 silver badges16 bronze badges

2 Comments

jmorris0x0 Over a year ago

Whether it works or not, UTF-8 is not a valid argument for CURLOPT_ENCODING. This specifies the Accept-Encoding Field, and has nothing to do with character encoding. Valid arguments are: identity, gzip, deflate and "".

corretge Over a year ago

I had different response for the same URL when request from CURL or from Browser. Lots of thanks for light me about CURLOPT_USERAGENT... now it works fine in both :)

Jake Pucan · Accepted Answer · 2017-10-26 02:52:19Z

0

You may also try.

...

$results = curl_exec($init);
curl_close($init);
return json_decode(utf8_encode($results));

utf8_encode encoded ASCII character. Returning a non-encoded ASCII may break or return an error (In my case).

answered Oct 26, 2017 at 2:52

Jake Pucan

6568 silver badges11 bronze badges

Comments

Marian Nasry · Accepted Answer · 2017-10-31 07:31:44Z

0

you can try

$res= curl_exec ( $ch ); 
$result = iconv("Windows-1251", "UTF-8", $res);

edited Oct 31, 2017 at 7:31

Marian Nasry

8159 silver badges22 bronze badges

answered Oct 31, 2017 at 6:59

Taron

3293 silver badges19 bronze badges

Comments

Toby Beresford · Accepted Answer · 2024-04-27 21:23:03Z

0

It can help to be check your parameters for mb_convert_encoding are the correct order. You specify the to_encoding as the second parameter and then the from_encoding as the third parameter.

So this code means convert from utf-8 to ISO-8859-1

$r = mb_convert_encoding($r,'ISO-8859-1','utf-8');

Switching them about helped solve the issue for me.

answered Apr 27, 2024 at 21:23

Toby Beresford

1,0489 silver badges18 bronze badges

Collectives™ on Stack Overflow

PHP CURL isn't processing encoded return data properly

5 Answers 5

Comments

2 Comments

Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

5 Answers 5

Comments

2 Comments

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related