Python saving xml from webservice

Question

I'm using a webservice to get a certain xml file from it. It works fine with urllib2 I get the xml as fileobject. So I want to know what would be the fastest way to store that somewhere in memory or not even store just parse it.

I tried iterparse on that object and it takes too long unless I save it first in file, then iterparse takes much less time.

So now I'm using this code to store it locally first and then do with that file what I want, and I would like to know is there a fastest way of doing it, fastest way of storing files.

url = "webservice"
s = urllib2.urlopen(url)

file = open("export.xml",'wb+')
for line in s:
    file.write(line)

Thanks

beerbajay · Accepted Answer · 2012-03-14 08:31:17Z

10

You don't need to write line-by-line. Just write the whole thing in one go:

>>> import urllib2
>>> url = "webservice"
>>> s = urllib2.urlopen(url)
>>> contents = s.read()
>>> file = open("export.xml", 'w')
>>> file.write(contents)
>>> file.close()

answered Mar 14, 2012 at 8:31

beerbajay

20.5k8 gold badges63 silver badges78 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

iblazevic Over a year ago

Yes I can, but the speed is actually the same, and I'm after the speed in this case

beerbajay Over a year ago

While there might be moderately faster techniques, the speed constraints here are probably network- and disk-based.

MagTun Over a year ago

If you get an error write() argument must be str, not bytes, use wb instead of wfor the open command.

Kien Truong · Accepted Answer · 2012-03-14 09:03:59Z

1

You can store it in a string:

content = s.read()

or a StringIO if you need file-like interface

content = cStringIO.StringIO()
content.write(s.read)

answered Mar 14, 2012 at 9:03

Kien Truong

11.4k2 gold badges34 silver badges36 bronze badges

Collectives™ on Stack Overflow

Python saving xml from webservice

2 Answers 2

3 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

3 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related