Parsing sub-element using selenium - python

Question

Here is a screenshot of the html structure:

I want to go through each item of league-list(every league-item) and look for the value aria-expanded.

Here is my code:

_1bet = 'https://1bet.com/ca/sports/tennis?time_range=all'
driver.get(_1bet) # enter the website
league1 = driver.find_elements_by_class_name('league-list')[0]  # first league-item
league1.find_element_by_xpath(".//div[@class='league-title.d-flex.justify-content-between.align-items-center.collapsible']")

Selenium can't find any element and I don't understand why. for reference I was inspired by another post : Parsing nested elements using selenium not working - python

@Prophet, sorry to bother again but If you can help It would be appreciated — lalaland
– lalaland, Commented Jul 24, 2021 at 19:54

Prophet · Accepted Answer · 2021-07-24 20:06:59Z

1

First of all you have to add a wait to make a page loaded before accessing the elements there.
Then you can get all those elements into the list and then iterate over the list getting each element attribute.
I'm not sure the list is initially expanded as it is presented on your picture.
Also not sure all those league-title elements are matching the selector you provided.
If not - we can correct the code accordingly

from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

wait = WebDriverWait(driver, 20)

_1bet = 'https://1bet.com/ca/sports/tennis?time_range=all'
driver.get(_1bet) # enter the website
wait.until(EC.visibility_of_element_located((By.CSS_SELECTOR, "div.league-list")))
league1 = driver.find_elements_by_class_name('league-list')[0]  # first league-item
titles = league1.find_elements_by_xpath(".//div[@class='league-title.d-flex.justify-content-between.align-items-center.collapsible']")
for title in titles:
    print(title.get_attribute("aria-expanded"))

answered Jul 24, 2021 at 20:06

Prophet

33.5k28 gold badges58 silver badges90 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

lalaland Over a year ago

it didn't work. It doesn't seem to find it as it returns an empty list for titles. I need to leave for now. will continue to test later. So I apologize if I don't answer soon

Prophet Over a year ago

No problem. Just put a delay after driver.get(_1bet) something like time.sleep(10) and let me know if this worked. It's a problem that we can't access that page.

Collectives™ on Stack Overflow

Parsing sub-element using selenium - python

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related