How to download file from url using python in the same format?

Question

I have to download file, I see I can do it using "urllib2".

response = urllib2.urlopen(URL)
file=response.read()

But, I can't read line by line.

Here's what I tried:

response = urllib2.urlopen(URL)
for line in response.read():
    #do stuff

All the file is one line. The original file was split by new lines.

Can someone tell me how to change the file to be like the original one?

response = urllib2.urlopen('mirror1.malwaredomains.com/files/domains.txt') for line in response.read(): — shira stenmetz
– shira stenmetz, Commented Feb 22, 2016 at 15:16
Sorry, maybe I was not clear, could you add example data from the webpage you are opening? — Rob Murray
– Rob Murray, Commented Feb 22, 2016 at 15:17

Julien Spronck · Accepted Answer · 2016-02-22 15:31:51Z

1

Just split the output:

response = urllib2.urlopen(URL)
lines=response.read().splitlines()

answered Feb 22, 2016 at 15:31

Julien Spronck

15.5k5 gold badges50 silver badges57 bronze badges

Sign up to request clarification or add additional context in comments.

1 Answer 1