Why doesn't cssselect work with html5parser?

Question

I'm trying to use cssselect on some HTML page parsed by lxml, but I found that only one parser gives the expected result:

This works just fine:

lxml.html.fromstring("...").cssselect("div.foo")

This returns no results:

lxml.html.html5parser.fromstring("...").cssselect("div.foo")

What's the difference? And can I get cssselect to work with html5parser?

David Jones · Accepted Answer · 2022-02-14 09:32:15Z

1

Please see these two answers about the reason:

How to remove namespace value from inside lxml.html.html5paser element tag

lxml html5parser ignores "namespaceHTMLElements=False" option

In short, the reason is that the parse from html5lib adds namespace html to the element tree while other parsers don't.

I think it should be a bug, from lxml side, maybe... To fix this:

import lxml.html.html5parser
from html5lib import HTMLParser
from html5lib.treebuilders.etree_lxml import TreeBuilder

parser = HTMLParser(tree=TreeBuilder, namespaceHTMLElements=False)
print(lxml.html.html5parser.fromstring("<div class=\"foo\"></div>", parser=parser))

edited Feb 14, 2022 at 9:32

David Jones

5,2414 gold badges36 silver badges48 bronze badges

answered Jul 28, 2019 at 3:29

Sraw

20.6k11 gold badges61 silver badges93 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Why doesn't cssselect work with html5parser?

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related