Python Selenium: Can get web's element but cannot get the text in it

Question

https://www.futunn.com/en/stock/FUTU-US This webpage, Say I would like to get float value

 # -*- coding: utf-8 -*-
from selenium import webdriver
options = webdriver.ChromeOptions()
options.add_argument('--ignore-certificate-errors')
options.add_argument('--ignore-ssl-errors')
PATH='C:\\Users\\admin\\Documents\\chromedriver.exe'
driver = webdriver.Chrome(PATH,chrome_options=options)

driver.get('https://www.futunn.com/en/stock/FUTU-US')
freeflowtickers=driver.find_element_by_xpath("//*[@id=\"app\"]/div/div[3]/section[1]/div[4]/div[9]/div[4]/div[2]")
print(freeflowtickers)
print(freeflowtickers.text)

Then run it, in the console, you get

<selenium.webdriver.remote.webelement.WebElement (session="08bc2133e5e3b6911cea32c6750833a8", element="e38cb418-2e37-428d-af4b-e01dd3e691ae")>

But after it no text is aquired.

How could this happen?

undetected Selenium · Accepted Answer · 2021-12-14 19:14:27Z

To print the text 64.11M you can use either of the following Locator Strategies:

Using xpath and get_attribute("innerHTML"):

print(driver.find_element(By.XPATH, "//div[text()='Float']//following-sibling::div[1]").get_attribute("innerHTML"))

Using xpath and text attribute:

print(driver.find_element(By.XPATH, "//div[text()='Float']//following-sibling::div[1]").text)

Ideally you need to induce WebDriverWait for the visibility_of_element_located() and you can use either of the following Locator Strategies:

Using XPATH and text attribute:

driver.get("https://www.futunn.com/en/stock/FUTU-US")
WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.XPATH, "//div[@class='stock-detail-btn']/i"))).click()
print(WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.XPATH, "//div[text()='Float']//following-sibling::div[1]"))).text)

Using XPATH and get_attribute("innerHTML"):

driver.get("https://www.futunn.com/en/stock/FUTU-US")
WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.XPATH, "//div[@class='stock-detail-btn']/i"))).click()
print(WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.XPATH, "//div[text()='Float']//following-sibling::div[1]"))).get_attribute("innerHTML"))

Note : You have to add the following imports :

from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC

You can find a relevant discussion in How to retrieve the text of a WebElement using Selenium - Python

References

Link to useful documentation:

get_attribute() method Gets the given attribute or property of the element.
text attribute returns The text of the element.
Difference between text and innerHTML using Selenium

Sam · Accepted Answer · 2021-12-14 17:17:46Z

0

So this isn't the cleanest solution but I just tested it and it's working.

float_element = driver.find_element_by_xpath('//*[@id="app"]/div/div[3]/section[1]/div[4]/div[9]/div[4]')
number = float_element.text.split("\n")[1]

I've grabbed the xpath of the parent div tag which contains two lines of text "Float" and the number which are separated by a newline.

answered Dec 14, 2021 at 17:17

Sam

9138 silver badges14 bronze badges

2 Comments

pg daszzz Over a year ago

I tested it and found that I have to manually hit the drop down button to show the float data. Did you get there data without manually hit that drop down button?

Sam Over a year ago

I believe not, as it's dynamic content you'll have to use selenium to find the dropdown element and click it.

Collectives™ on Stack Overflow

Python Selenium: Can get web's element but cannot get the text in it

2 Answers 2

References

Comments

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

References

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related