Reduce Bandwidth usage in cURL PHP

Question

I'm using basic cURL requests to fetch webpages in PHP, however these webpages are big in size and I'm limited in bandwidth usage.

Is there a way to reduce/optimize cURL data usage, for example using compression. I also heard that Brotli compression is the best, but I'm not sure how to use it.

symcbean · Accepted Answer · 2021-04-15 23:51:58Z

2

$headers[] = "Accept-Encoding: gzip"; // tell the server you accept gzip
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, $url);
curl_setopt($ch, CURLOPT_HTTPHEADER, $headers);
curl_setopt($ch, CURLOPT_BINARYTRANSFER, true);
curl_setopt($ch,CURLOPT_ENCODING , "gzip"); // tells curl to gunzip it automatically
$data = curl_exec($ch);

Not tried this with brotli, support will vary by software version which you didn't tell us about.

answered Apr 15, 2021 at 23:51

symcbean

48.4k6 gold badges63 silver badges99 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

user3137873 Over a year ago

Do you have an estimate percentage of bandwidth that gzip could save me? Also I'm using Apache...

symcbean Over a year ago

No - because it depends on your content. For 7-bit natural language, I would expect in the region of 70-90% reduction. Gif, png and jpg data is already highly compressed and gzipping will make them slightly larger (hence a correctly configured webserver won't attempt to compress these).

user3137873 Over a year ago

Hmm I see, is there a way to determine how much bandwidth cURL uses (in PHP) to test the difference?

Collectives™ on Stack Overflow

Reduce Bandwidth usage in cURL PHP

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related