Python XML Iteration

Question

I am trying to iterate through XML from a Requests response. Right now my python code look as such:

data = requests.post(url, data=xml, headers=headers).content
tree = ElementTree.fromstring(data)

And my XML looks as such:

<?xml version="1.0" encoding="utf-8"?>
<soap:Envelope xmlns:soap="http://schemas.xmlsoap.org/soap/envelope/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema">
<soap:Body>
<GetPasswordResponse xmlns="https://tempuri.org/">
    <GetPasswordResult>
    <Content>ThisisContent</Content>
    <UserName>ExampleName</UserName>
    <Address>ExServer</Address>
    <Database>tempdb</Database>
    <PolicyID>ExPolicy</PolicyID>
    <Properties>
        <KeyAndValue>
            <key>Content</key>
            <value>ThisisContent</value>
        </KeyAndValue>
        <KeyAndValue>
            <key>ReconcileIsWinAccount</key>
            <value>Yes</value>
        </KeyAndValue>
    </Properties>
    </GetPasswordResult>
</GetPasswordResponse>
</soap:Body></soap:Envelope>'

How would I go about pulling out the values for the <Content>, <UserName>, and <PolicyID> tags using ElementTree? I have tried many different things but can't seem to get any of the values accessible.

Post what you think is your best attempt and we can work with that. This XML uses namespaces which is a bit tricky with ElementTree. Parsing XML with namespaces is a good resource. — tdelaney
– tdelaney, Commented Dec 16, 2020 at 21:10

user5386938 · Accepted Answer · 2020-12-16 21:16:07Z

That's a little tricky since you have elements with a namespace but no prefix.

from xml.etree import ElementTree as ET

data = '''\
<?xml version="1.0" encoding="utf-8"?>
<soap:Envelope xmlns:soap="http://schemas.xmlsoap.org/soap/envelope/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema">
<soap:Body>
<GetPasswordResponse xmlns="https://tempuri.org/">
    <GetPasswordResult>
    <Content>ThisisContent</Content>
    <UserName>ExampleName</UserName>
    <Address>ExServer</Address>
    <Database>tempdb</Database>
    <PolicyID>ExPolicy</PolicyID>
    <Properties>
        <KeyAndValue>
            <key>Content</key>
            <value>ThisisContent</value>
        </KeyAndValue>
        <KeyAndValue>
            <key>ReconcileIsWinAccount</key>
            <value>Yes</value>
        </KeyAndValue>
    </Properties>
    </GetPasswordResult>
</GetPasswordResponse>
</soap:Body></soap:Envelope>
'''

tree = ET.fromstring(data)
nmsp = {
    'soap': 'http://schemas.xmlsoap.org/soap/envelope/',
    'x': 'https://tempuri.org/',
}  # NAMESPACE PREFIX ASSIGNMENT

print(tree.find('.//x:Content', namespaces=nmsp).text)
print(tree.find('.//x:UserName', namespaces=nmsp).text)
print(tree.find('.//x:PolicyID', namespaces=nmsp).text)

yazz · Accepted Answer · 2020-12-17 05:48:27Z

There is a library that doesn't need to consider the XML namespace.

from simplified_scrapy import utils, SimplifiedDoc, req
xml = '''
<?xml version="1.0" encoding="utf-8"?>
<soap:Envelope xmlns:soap="http://schemas.xmlsoap.org/soap/envelope/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema">
<soap:Body>
<GetPasswordResponse xmlns="https://tempuri.org/">
    <GetPasswordResult>
    <Content>ThisisContent</Content>
    <UserName>ExampleName</UserName>
    <Address>ExServer</Address>
    <Database>tempdb</Database>
    <PolicyID>ExPolicy</PolicyID>
    <Properties>
        <KeyAndValue>
            <key>Content</key>
            <value>ThisisContent</value>
        </KeyAndValue>
        <KeyAndValue>
            <key>ReconcileIsWinAccount</key>
            <value>Yes</value>
        </KeyAndValue>
    </Properties>
    </GetPasswordResult>
</GetPasswordResponse>
</soap:Body></soap:Envelope>
'''

# xml = req.post(url, data=xml, headers=headers)
doc = SimplifiedDoc(xml)
nodes = doc.select('GetPasswordResult').selects('Content|UserName|PolicyID')
print ([(node.tag, node.text) for node in nodes])

Result:

[('Content', 'ThisisContent'), ('UserName', 'ExampleName'), ('PolicyID', 'ExPolicy')]

Collectives™ on Stack Overflow

Python XML Iteration

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related