load and parse HTML string

Question

When I try to parse search results from Google I get an error

code

$html = file_get_contents('http://www.google.dk/search?q='.urlencode($query).'&start=0&num=100', false, $context);
                
$doc = new DOMDocument();
$doc->loadHTML($html);

error

PHP Warning:  DOMDocument::loadHTML(): Input is not proper UTF-8, indicate encoding ! in Entity, line: 1 in /var/www/dynaccount.com/class/Cronjob_check_serp_position.php on line 132

Warning: DOMDocument::loadHTML(): Input is not proper UTF-8, indicate encoding ! in Entity, line: 1 in /var/www/dynaccount.com/class/Cronjob_check_serp_position.php on line 132
PHP Warning:  DOMDocument::loadHTML(): htmlParseEntityRef: expecting ';' in Entity, line: 1 in /var/www/dynaccount.com/class/Cronjob_check_serp_position.php on line 132

Warning: DOMDocument::loadHTML(): htmlParseEntityRef: expecting ';' in Entity, line: 1 in /var/www/dynaccount.com/class/Cronjob_check_serp_position.php on line 132
PHP Warning:  DOMDocument::loadHTML(): htmlParseEntityRef: expecting ';' in Entity, line: 1 in /var/www/dynaccount.com/class/Cronjob_check_serp_position.php on line 132

can you print_r the $html please?

Daniel Krom
– Daniel Krom

2015-07-26 09:19:48 +00:00
Commented Jul 26, 2015 at 9:19 — Daniel Krom
– Daniel Krom, Commented Jul 26, 2015 at 9:19
possible duplicate of Dom LoadHTML Problem in PHP

Avalanche
– Avalanche

2015-07-26 09:32:05 +00:00
Commented Jul 26, 2015 at 9:32 — Avalanche
– Avalanche, Commented Jul 26, 2015 at 9:32

Professor Abronsius · Accepted Answer · 2015-07-26 09:42:44Z

1

libxml has some built in error handling which would help

            $query='php rocks';

            $data=file_get_contents('http://www.google.co.uk/search?q='.urlencode( $query ).'&start=0&num=100');
            libxml_use_internal_errors( true );
            $html = new DOMDocument('1.0','utf-8');
            $html->validateOnParse=false;
            $html->standalone=true;
            $html->preserveWhiteSpace=true;
            $html->strictErrorChecking=false;
            $html->substituteEntities=false;
            $html->recover=true;
            $html->formatOutput=true;
            $html->loadHTML( $data );
            $parse_errs=serialize( libxml_get_last_error() );
            libxml_clear_errors();


            $xpath=new DOMXPath( $html );
            $div=$html->getElementById('ires');
            $col=$xpath->query("ol/li/h3/a", $div );

            foreach( $col as $node ) echo $node->getAttribute('href').'<br />';

            $html=null;
            $xpath=null;

answered Jul 26, 2015 at 9:42

Professor Abronsius

33.9k5 gold badges36 silver badges49 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

clarkk Over a year ago

Thanks.. But how do I get the <div class="g"> elements inside $div ?

Collectives™ on Stack Overflow

load and parse HTML string

code

error

1 Answer 1

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

code

error

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related