Registering Namespace in Python XPath query

Question

This is the XML document that I have:

<products xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
  <Product Id="1">
      <Product Id="1_1">
        <Attribute Name="Whatever"></Attribute>
      </Product>
      <Attributes xmlns="http://some/path/to/entity/def">
        <Attribute Name="Identifier">NumberOne</Attribute>
      </Attributes>
  </Product>
  <Product Id="2">
    <Attributes xmlns="http://some/path/to/entity/def">
      <Attribute Name="Identifier">NumberTwo</Attribute>
    </Attributes>
  </Product>
</products>

I'm trying to use XPath for getting a Product by its child Attributes.Attribute[Name=Identifier] value (e.g. "NumberOne"). So in that case my expected result would be:

<Product Id="1">
      <Product Id="1_1">
        <Attribute Name="Whatever"></Attribute>
      </Product>
      <Attributes xmlns="http://some/path/to/entity/def">
        <Attribute Name="Identifier">NumberOne</Attribute>
      </Attributes>
</Product>

Based on this explanation, I tried to implement the query in Python by using the lxml lib:

found_products = xml_tree_from_string.xpath('//products//Product[c:Attributes[Attribute[@Name="Identifier" and text()="NumberOne"]]]', namespaces={"c": "http://some/path/to/entity/def"})

Unfortunately, this never returns a result due to the Attributes namespace definition.

What am I missing?

kjhughes · Accepted Answer · 2020-12-20 16:33:25Z

2

What am I missing?

You're missing that Attribute is also in the same namespace as Attributes because default namespace declarations are inherited by descendent XML elements.

So, just add a c: to Attribute in your XPath, and it should work as you observed in your comment to Jack's answer.

answered Dec 20, 2020 at 16:33

kjhughes

113k31 gold badges198 silver badges276 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Jack Fleeting · Accepted Answer · 2020-12-20 14:35:14Z

1

You need to first define a namespace map, declare a prefix for those namespaces that don't have one (as is the case here) and then apply xpath:

from lxml import etree
prods ="""[your xml above]"""
ns = { (k if k else "xx"):(v) for k, v in doc.xpath('//namespace::*') } #create ns map
doc = etree.XML(prods)
for product in doc.xpath('//products//Product[.//xx:Attribute[@Name="Identifier"][text()="NumberOne"]]', namespaces=ns):
    print(etree.tostring(product).decode())

Output:

<Product xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" Id="1">
      <Product Id="1_1">
        <Attribute Name="Whatever"/>
      </Product>
      <Attributes xmlns="http://some/path/to/entity/def">
        <Attribute Name="Identifier">NumberOne</Attribute>
      </Attributes>
  </Product>

To suppress the namespaces attributes, change the for loop to:

for product in doc.xpath('//products//Product[.//xx:Attribute[@Name="Identifier"][text()="NumberOne"]]', namespaces=ns):
    etree.cleanup_namespaces(doc) #note: the parameter is "doc", not "product"
    print(etree.tostring(product).decode())

Output:

<Product Id="1">
      <Product Id="1_1">
        <Attribute Name="Whatever"/>
      </Product>
      <Attributes xmlns="http://some/path/to/entity/def">
        <Attribute Name="Identifier">NumberOne</Attribute>
      </Attributes>
  </Product>

edited Dec 20, 2020 at 14:35

answered Dec 20, 2020 at 13:51

Jack Fleeting

25k6 gold badges27 silver badges49 bronze badges

7 Comments

user2549803 Over a year ago

Thanks a lot. Is it possible to keep the top level Product definition as it was in the original XML file? I mean without the xmlns definitions. Fun fact - alternatively my initial approach works if I add the c: prefix to the Attribute as well.

Jack Fleeting Over a year ago

@user2549803 Yes, it's possible. See edit.

kjhughes Over a year ago

@JackFleeting: Dynamically creating the namespace prefix map like this would be overkill in most situations, including this one, and requires a more sophisticated approach to account for the possibility of different default namespaces at different points in the XML hierarchy.

Jack Fleeting Over a year ago

@kjhughes Absolutely right - except that when I go to the other extreme and suggest a purely local-name() based solution, I get whacked upside the head for taking a cavalier attitude to namespaces..

kjhughes Over a year ago

Oh no, wasn't suggesting that you defeat namespaces -- just that you use the namespace prefix mechanism directly without the partially general generation code you have. At least state its limitations so that future readers won't be surprised that it's not as general as it appears to be. Really, though, I'd just back off the generality and fix OP's XPath to include c: on the descendent elements of Attribute and call it done. Feel free to pull from my answer below and elaborate as needed.

|

Collectives™ on Stack Overflow

Registering Namespace in Python XPath query

2 Answers 2

Comments

7 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

7 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related