Using selenium in python to extract values in this form

Question

How can I extract the value from a html file in this form using selenium:

<body>
   <div class="some stuff">
      <span class="some other stuff">the number wanted</span>
   </div>
</body>

I tried using the get_attribute function on the element but that can only return the class.

Code so far

from selenium import webdriver
from selenium.webdriver.common.keys import Keys

driver = webdriver.Chrome()
driver.get("website")
elem = driver.find_element_by_xpath('xpath to wherever')
print(elem.get_attribute("value")) #tried originally
driver.close()

Also important to note that the website must be signed in the particular website I was trying wouldnt work for most people. Thanks for any help.

Can we see your code so far?

Thaer A
– Thaer A

2020-03-29 22:42:45 +00:00
Commented Mar 29, 2020 at 22:42 — Thaer A
– Thaer A, Commented Mar 29, 2020 at 22:42
added code now, with generalised bits

user3486373
– user3486373

2020-03-29 22:45:56 +00:00
Commented Mar 29, 2020 at 22:45 — user3486373
– user3486373, Commented Mar 29, 2020 at 22:45
I've added an answer, if it doesn't work let us know.

Thaer A
– Thaer A

2020-03-29 22:48:48 +00:00
Commented Mar 29, 2020 at 22:48 — Thaer A
– Thaer A, Commented Mar 29, 2020 at 22:48

Thaer A · Accepted Answer · 2020-03-29 22:55:12Z

1

If your data is within the < span >, you can use .text to get the inner text of the element.

from selenium import webdriver
from selenium.webdriver.common.keys import Keys

driver = webdriver.Chrome()
driver.get("website")
elem = driver.find_element_by_xpath('xpath to wherever')
print(elem.text) #Get the inner text of elem
driver.close()

edited Mar 29, 2020 at 22:55

answered Mar 29, 2020 at 22:48

Thaer A

2,3331 gold badge14 silver badges14 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

frianH · Accepted Answer · 2020-03-30 04:39:19Z

1

Other approach you can use .get_attribute("innerHTML"), it can be used to get text inside the span tag.

While .get_attribute ("value") can be used for other component type such as input

answered Mar 30, 2020 at 4:39

frianH

7,5916 gold badges26 silver badges49 bronze badges

Collectives™ on Stack Overflow

Using selenium in python to extract values in this form

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related