Python reading or storing html source line by line

Question

I just start to learn python 3.( I was reading python book and i got questions...)

I have questions to read and find key word from the html source.

I wrote to code for open the url. For example,

page =urllib.request.urlopen(some url)
text = page.read().decode("utf8")

Therefore, I assume that text contain all html code and text is object.

Question 1. I would like to some kind of array or arraylist to store html source code. However, I am not really sure how to get line of code from "text" object and store to some kind of array.

Question 2. Does python have "contain" function to find the special key word like "stack overflow" from the array ?

thanks.

Use a HTML Parser; docs.python.org/2/library/htmlparser.html and your whole HTML source will turn into a interactable object. — user1467267
– user1467267, Commented Apr 10, 2013 at 22:23
@Allendar -- only don't use a standard library parser - it is crappy :) BeautifulSoup maybe? — root
– root, Commented Apr 10, 2013 at 22:28

Mikkel · Accepted Answer · 2013-04-10 22:29:25Z

1

If you want to parse the entire HTML document structure, don't try to program it all yourself - do like Allendar says and use a library for it.

If you just want to search and find specific things inside the text, use regular expressions ("re" module).

It doesn't really make sense to talk about "lines" of HTML in the traditional meaning of lines (CR/LF). The entire page could be in one line. It is tags that structure HTML, not lines.

answered Apr 10, 2013 at 22:29

Mikkel

3,3142 gold badges20 silver badges21 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Python reading or storing html source line by line

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related