PHP Simple HTML DOM Scrape External URL

Question

I'm trying to build a personal project of mine, however I'm a bit stuck when using the Simple HTML DOM class.

What I'd like to do is scrape a website and retrieve all the content, and it's inner html, that matches a certain class.

My code so far is:

    <?php
    error_reporting(E_ALL);
    include_once("simple_html_dom.php");
    //use curl to get html content
    $url = 'http://www.peopleperhour.com/freelance-seo-jobs';

    $html = file_get_html($url);

    //Get all data inside the <div class="item-list">
    foreach($html->find('div[class=item-list]') as $div) {
    //get all div's inside "item-list"
    foreach($div->find('div') as $d) {
    //get the inner HTML
    $data = $d->outertext;
    }
    }
print_r($data)
    echo "END";
    ?>

All I get with this is a blank page with "END", nothing else outputted at all.

Possible duplicate of Scrape web page contents

John Slegers
– John Slegers

2016-02-25 16:55:33 +00:00
Commented Feb 25, 2016 at 16:55 — John Slegers
– John Slegers, Commented Feb 25, 2016 at 16:55

Vash The Stampede · Accepted Answer · 2013-12-09 16:20:24Z

1

It seems your $data variable is being assigned a different value on each iteration. Try this instead:

$data = "";
foreach($html->find('div[class=item-list]') as $div) {
    //get all divs inside "item-list"
    foreach($div->find('div') as $d) {
         //get the inner HTML
         $data .= $d->outertext;
    }
}
print_r($data)

I hope that helps.

edited Dec 9, 2013 at 16:20

answered Dec 9, 2013 at 16:14

Vash The Stampede

4514 silver badges8 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

MikeF Over a year ago

Unfortunately this still wouldn't work. However, when defining the class like Sheikh's answer, it works perfectly.

The Alpha · Accepted Answer · 2013-12-09 16:21:50Z

0

I think, you may want something like this

$url = 'http://www.peopleperhour.com/freelance-seo-jobs';
$html = file_get_html($url);
foreach ($html->find('div.item-list div.item') as $div) {
    echo $div . '<br />';
};

This will give you something like this (if you add the proper style sheet, it'll be displayed nicely)

enter image description here

edited Dec 9, 2013 at 16:21

answered Dec 9, 2013 at 16:15

The Alpha

147k30 gold badges294 silver badges313 bronze badges

2 Comments

MikeF Over a year ago

Perfect! Works as expected. How come it wouldn't work when defining the class like: div[class=item-list]?

pguardiario Over a year ago

You probably needed quotes around item-list.

Collectives™ on Stack Overflow

PHP Simple HTML DOM Scrape External URL

2 Answers 2

1 Comment

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related