Selenium - Extract text in div without other tags (Python)

Question

Trying to figure out how to access the text in the screenshot below without pulling all the span tags.

Doing element = driver.find_elements_by_id('response') gives me a list, but I can't seem to dig down further to access the text I want.

I also tried this after doing some searching:

element = driver.find_element_by_xpath("//div[@id='response']/pre")

But I get the same result.

Any tips?

Doing element = driver.find_elements_by_id('response') gives me a list <--- Have you tried just element = driver.find_element_by_id('response')? — Remi Guan
– Remi Guan, Commented Jan 7, 2016 at 23:54
Yeah, that also gives me a long list with all the span tags. — Scribble_Scratch
– Scribble_Scratch, Commented Jan 7, 2016 at 23:57
Unfortunately none of this code loads until after inputting a bunch of fields, so won't really help — Scribble_Scratch
– Scribble_Scratch, Commented Jan 8, 2016 at 0:04

surender pal · Accepted Answer · 2020-10-12 07:46:37Z

1

element.get_attribute('innerHTML')

this will help you to get the text between two div tag

answered Oct 12, 2020 at 7:46

surender pal

5156 silver badges16 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Kevin Eichhorn · Accepted Answer · 2016-01-08 00:11:59Z

0

element.text

Should give out the contents of the element without any HTML tags.

answered Jan 8, 2016 at 0:11

Kevin Eichhorn

3172 silver badges2 bronze badges

Eduardo Perez · Accepted Answer · 2019-02-14 23:14:44Z

0

In the case of the text being in the pure div the text is not extracted using element.text

Example:

<div>the text here</div>

I recommend to use a library called html2text and next:

html2text(element.get_attribute("outerHTML"))

It will do the trick!

answered Feb 14, 2019 at 23:14

Eduardo Perez

1312 silver badges5 bronze badges