Scraping same class Selenium

Question

I want to scrape Home team and Away team from this page https://www.flashscore.com/match/hY5c1Bhh/#match-summary/match-summary

    # Get HomeTeam
    _ht = driver.find_element_by_xpath('//*[contains(@class, "home")]')
    ht = _ht.find_element_by_xpath('//*[contains(@class, "participantName")]')
    _homeName = ht.text
    
    # Get AwayTeam
    _at = driver.find_element_by_xpath('//*[contains(@class, "away")]')
    at = _at.find_element_by_xpath('//*[contains(@class, "participantName")]')
    _awayName = at.text

Output

Longford
Longford

cruisepandey · Accepted Answer · 2021-05-19 13:14:13Z

1

try to store both of them in a list like this :

teams = driver.find_elements(By.CSS_SELECTOR, "div[class^='participantName'] a")
print("Home team : ", teams[0].text)
print("Away team : ", teams[1].text)

answered May 19, 2021 at 13:14

cruisepandey

29.5k6 gold badges23 silver badges43 bronze badges

Sign up to request clarification or add additional context in comments.

12 Comments

luka Over a year ago

I tried the same for scores in this page flashscore.com/match/OxfWpyjH/#match-summary/match-summary

scores = driver.find_elements(By.CSS_SELECTOR, "div[class^='incidentsHeader']") _1hf = scores[0].text _2hf = scores[1].text

but got IndexError: list index out of range

cruisepandey Over a year ago

@luca use the same CSS_SELECTOR if you are looking to extract team names div[class^='participantName'] a same code should work.

luka Over a year ago

@cruisepandey yes it works, I can extract team names. But I have to scrape scores in middle of the page as well. I tried to use CSS_SELECTOR for "div[class^='incidentsHeader']")

cruisepandey Over a year ago

@luca : try this css selector div[class^='matchInfo'] div[class^='wrapper']

luka Over a year ago

@cruisepandey doesn't work blank output the previous code Index out of range

|

Prophet · Accepted Answer · 2021-05-19 13:10:38Z

0

You are missing the . when trying to locate element inside other element.
So your code should be

# Get HomeTeam
    _ht = driver.find_element_by_xpath('//*[contains(@class, "home")]')
    ht = _ht.find_element_by_xpath('.//*[contains(@class, "participantName")]')
    _homeName = ht.text
    
    # Get AwayTeam
    _at = driver.find_element_by_xpath('//*[contains(@class, "away")]')
    at = _at.find_element_by_xpath('.//*[contains(@class, "participantName")]')
    _awayName = at.text

answered May 19, 2021 at 13:10

Prophet

33.5k28 gold badges58 silver badges90 bronze badges

Collectives™ on Stack Overflow

Scraping same class Selenium

2 Answers 2

12 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

12 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related