php parse urls with multiple variables with get request

Question

I'm sending a php script multiple urls (about 15) at once, all containing about 5 url variables. In my script, I'm parsing the chunk of urls into individual ones by splitting them with two backslashes (which i add upon before to the script), and then curling each individual url. However, when I run my script, it only accepts a url up to the "&" symbol. I'd like to have the entire chunk, so that I can split it up later in my script. What might be the best way to approach this issue?

Thanks.

An example of what happens when i send my script a url chunk:

 <?php
    /*
    $url variable being sent to script:
    http://www.test1.com?q1=a&q2=b&q3=c&q4=d\\http://www.test2.com?r1=a&r2=b&r3=c&r4=d\\http://www.test3.com?q1=a&q2=b&q3=c&q4=d\\http://www.test4.com?e1=a&e2=b&e3=c&e4=d
    */

    $url = $_GET['url'];

    echo $url; // returns http://www.test1.com?q1=a

    //later on in my script, i just need to curl each "\\" seperated url
    ?>

This looks very much like an issue with the encoding of the URL - how is this data getting onto the query string in the first place? — John Parker
– John Parker, Commented Nov 5, 2009 at 7:57

timdev · Accepted Answer · 2009-11-05 08:02:40Z

1

You need to urlencode() the (data) URLs before appending them to your script's request.

Otherwise, PHP is going to to see ?listOfUrls=http://someurl.com/?someVar=SomeVal& and stop right there, due to the literal "&"

If you're building the query string in PHP you could try something like:

<?PHP
//imagine $urls is an array of urls
$qs = '?urls=';
foreach($urls as $u){
    $q .= urlencode($u) .'\\';
}

I also suspect you can play with [] notation in the url so that on the other side of the GET, you get a nice clean array of URLs back, instead of having to parse on some delimiter like "\"

answered Nov 5, 2009 at 8:02

timdev

63.1k6 gold badges86 silver badges93 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Artem Russakovskii · Accepted Answer · 2009-11-05 08:02:15Z

0

Since you didn't url encode your url param, everything after the first & is treated as the param to the original url.

answered Nov 5, 2009 at 8:02

Artem Russakovskii

22.1k18 gold badges97 silver badges120 bronze badges

Comments

outis · Accepted Answer · 2009-11-05 08:07:35Z

0

The $_GET array is formed by splitting on ampersands. URL-encode the URLs before passing them as parameters. PHP should decode them for you.

Example: pass url=http://www.test1.com?q1=a%26q2=b%26q3=c%26q4=d\\http://www.test2.com?r1=a%26r2=b%26r3=c%26r4=d\\http://www.test3.com?q1=a%26q2=b%26q3=c%26q4=d\\http://www.test4.com?e1=a%26e2=b%26e3=c%26e4=d

You can do away with the '\\' by turning the parameter into an array. Example: use url[]=http://www.test1.com?q1=a%26q2=b%26q3=c%26q4=d&url[]=http://www.test2.com?r1=a%26r2=b%26r3=c%26r4=d&url[]=http://www.test3.com?q1=a%26q2=b%26q3=c%26q4=d&url[]=http://www.test4.com?e1=a%26e2=b%26e3=c%26e4=d

edited Nov 5, 2009 at 8:07

answered Nov 5, 2009 at 8:02

outis

77.7k23 gold badges155 silver badges228 bronze badges

Collectives™ on Stack Overflow

php parse urls with multiple variables with get request

3 Answers 3

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related