Python Regex - Parsing HTML

Question

I have this little code and it's giving me AttributeError: 'NoneType' object has no attribute 'group'.

import sys
import re

#def extract_names(filename):

f = open('name.html', 'r')
text = f.read()

match = re.search (r'<hgroup><h1>(\w+)</h1>', text)
second = re.search (r'<li class="hover">Employees: <b>(\d+,\d+)</b></li>', text)  

outf = open('details.txt', 'a')
outf.write(match)
outf.close()

My intention is to read a .HTML file looking for the <h1> tag value and the number of employees and append them to a file. But for some reason I can't seem to get it right. Your help is greatly appreciated.

I think that some higher level libraries like Scrapy of Beautiful Soap would fit better your task than regular expressions. — mariosangiorgio
– mariosangiorgio, Commented Sep 20, 2012 at 13:15
@larsmans: the myriad others also include this one which actually demonstrates how it is possible to parse HTML with regexes. And Helen's task right here is teeny-tiny compared to that. So not so trigger-happy. — ЯegDwight
– ЯegDwight, Commented Sep 20, 2012 at 15:28
It’s a shame you can’t use vi to edit HTML files, innit? — tchrist
– tchrist, Commented Sep 20, 2012 at 15:54
If you show the relevant portions of the HTML file you are looking at, it would help a great deal. — tchrist
– tchrist, Commented Sep 21, 2012 at 18:02

Martijn Pieters · Accepted Answer · 2012-09-20 13:22:23Z

6

You are using a regular expression, but matching XML with such expressions gets too complicated, too fast. Don't do that.

Use a HTML parser instead, Python has several to choose from:

ElementTree is part of the standard library
BeautifulSoup is a popular 3rd party library
lxml is a fast and feature-rich C-based library.

The latter two handle malformed HTML quite gracefully as well, making decent sense of many a botched website.

ElementTree example:

from xml.etree import ElementTree

tree = ElementTree.parse('filename.html')
for elem in tree.findall('h1'):
    print ElementTree.tostring(elem)

edited Sep 20, 2012 at 13:22

answered Sep 20, 2012 at 13:15

Martijn Pieters

1.1m326 gold badges4.2k silver badges3.4k bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Fred Foo Over a year ago

Better use BeatifulSoup or lxml.html for HTML files, though -- more often than not, they're malformed XML.

Pierre GM · Accepted Answer · 2012-09-20 15:35:34Z

1

Just for the sake of completion: your error message just indicate that your regular expression failed and did not return anything...

answered Sep 20, 2012 at 15:35

Pierre GM

20.5k3 gold badges58 silver badges67 bronze badges

Collectives™ on Stack Overflow

Python Regex - Parsing HTML

2 Answers 2

1 Comment

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related