php cURL request using modified headers

Question

I want to capture the response of a site (http://gnocchi-www.buffalo-ggn.net/bingo2-v2.47.0-JACKET/js/cache/static_desktop_data.json) in my php file to write the available collection items in a databse.

If I enter the adress in my browser, I get a json string as response. But If I use a cURL request, I get an empty response.

Here is my curl code:

$url = 'http://gnocchi-www.buffalo-ggn.net/bingo2-v2.47.0-JACKET/js/cache/static_desktop_data.json';
$headers = array( 
        "Content-Type: application/x-www-form-urlencoded", 
        "Host: gnocchi-www.buffalo-ggn.net", 
        "Accept-Language: de-DE,de;q=0.8,en-US;q=0.6,en;q=0.4", 
        "Accept-Encoding: gzip,deflate,sdch", 
        "Accept: */*"
    ); 

$ch = curl_init( $url );
curl_setopt( $ch, CURLOPT_GET, true);
curl_setopt( $ch, CURLOPT_HEADER, true);
curl_setopt( $ch, CURLOPT_HTTPHEADER, $headers);
curl_setopt( $ch, CURLOPT_USERAGENT, "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/32.0.1700.107 Safari/537.36");
curl_setopt( $ch, CURLOPT_REFERER, "https://gs1.wac.edgecastcdn.net/805F48/gnocchi/bingo2-v2.47.0-JACKET/assets/Game.swf");
curl_setopt( $ch, CURLOPT_VERBOSE, true);
curl_setopt( $ch, CURLOPT_FOLLOWLOCATION, true);
curl_setopt( $ch, CURLOPT_RETURNTRANSFER, true);
$response=curl_exec( $ch );
echo $response;

the headers that are sent when I enter the url in browser are:

Host: gnocchi-www.buffalo-ggn.net

Connection: keep-alive

Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,/;q=0.8

User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/32.0.1700.107 Safari/537.36

Accept-Encoding: gzip,deflate,sdch

Accept-Language: de-DE,de;q=0.8,en-US;q=0.6,en;q=0.4

Can anyone help me with this problem ???

That exact code works for me - I get loads of JSON data (578604 bytes according to the returned Content-Length header). You get a few warnings for your code though - try turning on error_reporting(E_ALL); to see if you get some useful info out of it. — Nils
– Nils, Commented Feb 6, 2014 at 15:47
CURLOPT_GET option doesn't exists (php.net/manual/en/function.curl-setopt.php) — hindmost
– hindmost, Commented Feb 6, 2014 at 15:49
thx Nils and hindmost. On my other server it works fine. Dont really understand, but its working there. Thx for your help. Maybe I should have tried there before. — user3280178
– user3280178, Commented Feb 7, 2014 at 8:01

Sabuj Hassan · Accepted Answer · 2014-02-06 16:04:14Z

1

Remove this from your code:

"Accept-Encoding: gzip,deflate,sdch",

If you really want to send any encoding request, then Add this curl option with your code.

curl_setopt( $ch, CURLOPT_ENCODING, "");

Finally, this one doesn't have any effect on the modern version of libcurl. So remove this one.

curl_setopt( $ch, CURLOPT_GET, true);

answered Feb 6, 2014 at 16:04

Sabuj Hassan

39.7k14 gold badges83 silver badges88 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

user3280178 Over a year ago

Thx Sabuj. I removed them both, and it works like a charm on my other host.

Collectives™ on Stack Overflow

php cURL request using modified headers

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related