PHP Simple HTML DOM Parser - impossible to read url content in php Loop

Question

I am trying to find specific element from the pages below:

$links=array(
"https://www.computers.com/l_bg/?m=7&i=587609", 
"https://www.computers.com/l_bg/?m=7&i=587610", 
"https://www.computers.com/l_bg/?m=7&i=587607", 
"https://www.computers.com/l_bg/?m=7&i=587502"
); 


foreach($links as $link){
$newhtml = new simple_html_dom();
$newhtml->load_file($link);

foreach($newhtml->find('table.fpt > td.name') as $price){
echo $price=$price->innertext;
    }
}

but the $price is empty.. The strange thing is that if I change the code to this:

$newhtml = new simple_html_dom();

$newhtml->load_file('https://www.computers.com/l_bg/?m=7&i=587609');
foreach($newhtml->find('table.fpt > td.name') as $price){
echo $price=$price->innertext;
}

the code works.. Why if I manual put the url it works, but when is in loop it doesn't? Can you please tell me what is wrong and how to find it?

Try using the hard-coded link (as in your 2nd example) but put it in a loop that goes through 4-5 times for ($i=0; $i < 4; $i++) { ... } to see if it's some kind of timing issue. — Peter Bowers
– Peter Bowers, Commented Apr 2, 2015 at 18:25
I will test it now but same time to share what else I discovered: if I test the headers here webconfs.com/http-header-check.php with one of the urls jarcomputers.com/l_bg/?m=7&i=587609 I am getting HTTP/1.1 400 Bad Request => is this connected to this? — Europeuser
– Europeuser, Commented Apr 2, 2015 at 18:29
Yes, that could very well be it. Perhaps your jarcomputers.com is not returning the pages consistently. — Peter Bowers
– Peter Bowers, Commented Apr 2, 2015 at 18:37

Europeuser · Accepted Answer · 2015-04-02 18:37:49Z

1

The problem seems to be encoding problem. If the url has & its been transformed to & which must be replaced with & in order to work.. Thank you anyway for your help !

answered Apr 2, 2015 at 18:37

Europeuser

9421 gold badge10 silver badges35 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

PHP Simple HTML DOM Parser - impossible to read url content in php Loop

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related