How to click on element using find_elements_by_class_name() using Selenium and Python

Question

I have to following HTML that is on a website I'm trying to scrape:

<div class="test-section-container">
    <div>
        <span class="test-section-title">Section Title</span>
        <div style="display: inline-block; padding: 0.05rem;"></div>
    </div>
        <div style="cursor: pointer; background-color: rgb(248, 248, 248); display: flex; line-height: 1.2; margin-bottom: 0.07rem;">
            <div style="width: 0.5rem; flex-shrink: 0; background-color: rgb(245, 222, 136);"></div>
            <div style="padding: 0.07rem; overflow: hidden;">
                <div style="font-size: 0.18rem; text-overflow: ellipsis; overflow: hidden; white-space: nowrap;">Newsletter 1</div>
                <div style="font-size: 0.13rem; color: rgb(102, 102, 102);">2021 11 8</div>
            </div>
        </div>
        <div style="cursor: pointer; background-color: rgb(248, 248, 248); display: flex; line-height: 1.2; margin-bottom: 0.07rem;">
            <div style="width: 0.5rem; flex-shrink: 0; background-color: rgb(221, 221, 221);"></div>
            <div style="padding: 0.07rem; overflow: hidden;">
                <div style="font-size: 0.18rem; text-overflow: ellipsis; overflow: hidden; white-space: nowrap;">Newsletter 2 </div>
                <div style="font-size: 0.13rem; color: rgb(102, 102, 102);">2021 11 3</div>
            </div>
        </div>

This is the selenium/python code that I'm using:

driver.get("http://www.testwesbite.org/#/newsarticles")

results = driver.find_elements_by_class_name('test-section-container')
texts = []
for result in results:
    text = result.text
    texts.append(text)
    print(text)

This gives me an output off:

Newsletter 1
2021 11 8
Newsletter 2
2021 11 3

If I use the following code:

first_result = results[0]
first_result.click()

It does click into the first article but a results[1] give me an out of bounds error.

How would I go about click on the second article?

Thank you - quickly tested results[1] gives me an index out of range even if I haven't not tried results[0] — Gee1983
– Gee1983, Commented Nov 17, 2021 at 19:20

undetected Selenium · Accepted Answer · 2021-11-17 20:00:12Z

1

As you have used driver.find_elements_by_class_name('test-section-container') all the following texts:

Newsletter 1
2021 11 8
Newsletter 2
2021 11 3

Are within the results[0] element and results[1] desn't exists. Hence you face out of bounds error

Solution

To click on each results[0] and results[1] you can use:

driver.get("http://www.testwesbite.org/#/newsarticles")
results = driver.find_elements(By.CSS_SELECTOR, "div.test-section-container div[style*='nowrap']")
texts = []
for result in results:
    text = result.text
    texts.append(text)
    print(text)

Now you can click the individual items as:

first_result = results[0]
first_result.click()

and

second_result = results[1]
second_result.click()

Note: You have to add the following imports :

from selenium.webdriver.common.by import By

edited Nov 17, 2021 at 20:00

answered Nov 17, 2021 at 19:20

undetected Selenium

194k44 gold badges304 silver badges387 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Gee1983 Over a year ago

Thank you that makes sense but how would I go about click on one of the items inside that element?

undetected Selenium Over a year ago

@Gee1983 Checkout the updated answer and let me know the status.

Gee1983 Over a year ago

its working when I change the line to: results = driver.find_elements_by_css_selector("div.test-section-container div[style*='nowrap']") Its says By not defined when using By.CSS_SELECTOR Not sure if I'm using an outdated Selenium. Thank you very much for the quick response.

undetected Selenium Over a year ago

Added the import for By

Collectives™ on Stack Overflow

How to click on element using find_elements_by_class_name() using Selenium and Python

1 Answer 1

Solution

4 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Solution

4 Comments

Your Answer

Sign up or log in

Post as a guest

Related