how to parse unstructured xml file using python?

Question

How can i parse unstructured xml file? i need to get data inside patient tag and title using elementTree.

<?xml version="1.0" encoding="UTF-8"?>
<ClinicalDocument xmlns="urn:hl7-org:v3" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="urn:hl7-org:v3 CDA.xsd">
<templateId root="2.16.840.1.113883.10.20.22.1.1"/>
<id extension="4b78219a-1d02-4e7c-9870-dc7ce3b8a8fb" root="1.2.840.113619.21.1.3214775361124994304.5.1"/>
<code code="34133-9" codeSystem="2.16.840.1.113883.6.1" codeSystemName="LOINC" displayName="Summarization of episode note"/>
<title>Summary</title>
<effectiveTime value="20170919160921ddfdsdsdsd31-0400"/>
<confidentialityCode code="N" codeSystem="2.16.840.dwdwddsd1.113883.5.25"/>
<recordTarget>
<patientRole><id extension="0" root="1.2.840.113619.21.1.3214775361124994304.2.1.1.2"/>
<addr use="HP"><streetAddressLine>addd2 </streetAddressLine><city>fgfgrtt</city><state>tr</state><postalCode>121213434</postalCode><country>rere</country></addr>
<patient>
<name><given>fname</given><family>lname</family></name>
<administrativeGenderCode code="F" codeSystem="2.16.840.1.113883.5.1" displayName="Female"/>
<birthTime value="19501025"/>
<maritalStatusCode code="M" codeSystem="2434.16.840.1.143434313883.5.2" displayName="M"/>
<languageCommunication>
<languageCode code="eng"/>
<proficiencyLevelCode nullFlavor="NI"/>
<preferenceInd value="true"/>
</languageCommunication>
</patient>

i want given name , family name , gender and title.

Beautifull soup can handle bad xml crummy.com/software/BeautifulSoup/bs4/doc — mbieren
– mbieren, Commented Jun 25, 2019 at 13:28

DisappointedByUnaccountableMod · Accepted Answer · 2021-06-04 16:11:18Z

3

Using BeautifulSoup bs4 and lxml parser library to scrape xml data.

from bs4 import BeautifulSoup

xml_data = '''<?xml version="1.0" encoding="UTF-8"?>
<ClinicalDocument xmlns="urn:hl7-org:v3" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="urn:hl7-org:v3 CDA.xsd">
<templateId root="2.16.840.1.113883.10.20.22.1.1"/>
<id extension="4b78219a-1d02-4e7c-9870-dc7ce3b8a8fb" root="1.2.840.113619.21.1.3214775361124994304.5.1"/>
<code code="34133-9" codeSystem="2.16.840.1.113883.6.1" codeSystemName="LOINC" displayName="Summarization of episode note"/>
<title>Summary</title>
<effectiveTime value="20170919160921ddfdsdsdsd31-0400"/>
<confidentialityCode code="N" codeSystem="2.16.840.dwdwddsd1.113883.5.25"/>
<recordTarget>
<patientRole><id extension="0" root="1.2.840.113619.21.1.3214775361124994304.2.1.1.2"/>
<addr use="HP"><streetAddressLine>addd2 </streetAddressLine><city>fgfgrtt</city><state>tr</state><postalCode>121213434</postalCode><country>rere</country></addr>
<patient>
<name><given>fname</given><family>lname</family></name>
<administrativeGenderCode code="F" codeSystem="2.16.840.1.113883.5.1" displayName="Female"/>
<birthTime value="19501025"/>
<maritalStatusCode code="M" codeSystem="2434.16.840.1.143434313883.5.2" displayName="M"/>
<languageCommunication>
<languageCode code="eng"/>
<proficiencyLevelCode nullFlavor="NI"/>
<preferenceInd value="true"/>
</languageCommunication>
</patient>'''


soup = BeautifulSoup(xml_data, "lxml")

title = soup.find("title")
print(title.text.strip())

patient = soup.find("patient")
given = patient.find("given").text.strip()
family = patient.find("family").text.strip()
gender = patient.find("administrativegendercode")['displayname'].strip()

print(given)
print(family)
print(gender)

O/P:

Summary
fname
lname
Female

Install library dependency:

pip3 install beautifulsoup4==4.7.1
pip3 install lxml==4.3.3

edited Jun 4, 2021 at 16:11

DisappointedByUnaccountableMod

6,8444 gold badges21 silver badges23 bronze badges

answered Jun 25, 2019 at 13:28

bharatk

4,3455 gold badges19 silver badges31 bronze badges

Sign up to request clarification or add additional context in comments.

6 Comments

prasanna Over a year ago

what is the best way to read multiple xml files from folder using python?

bharatk Over a year ago

@prasanna try this stackoverflow.com/questions/52247468/…

prasanna Over a year ago

it is working fine, Thank You. but this python program is expecting both file and xml file must be in same folder??

prasanna Over a year ago

i am getting this error 'OSError: [Errno 2] No such file or directory: './user/root/SQP/raw_ccd/*'' in linux.

bharatk Over a year ago

@prasanna Please ask a new question, what you have tried python code with an error message.

|

kkarczewski · Accepted Answer · 2019-06-25 13:58:46Z

1

Or you can simply use lxml. Here is tutorial that I used: https://lxml.de/tutorial.html But it should be similar to:

from lxml import etree
root = etree.Element("patient")
print(root.find("given"))
print(root.find("family"))
print(root.find("give"))

answered Jun 25, 2019 at 13:58

kkarczewski

4215 silver badges21 bronze badges

6 Comments

prasanna Over a year ago

all the values are printing none.

prasanna Over a year ago

all values are printing none. please suggest me.

kkarczewski Over a year ago

Have you tried xpath with lxml? Here you have link to my github: github.com/kkarczewski/xml_operation/blob/master/xml_modify/… Try with first function get_element(path, xpath).

kkarczewski Over a year ago

you can modify that function to read text from string. Instead of tree = etree.parse(path) root = tree.getroot() you can use root = etree.fromstring(xml)

prasanna Over a year ago

still i am getting None only.

|

Collectives™ on Stack Overflow

how to parse unstructured xml file using python?

2 Answers 2

6 Comments

6 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

6 Comments

6 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related