Loop through divs inside div in Selenium/Python

Question

I have this HTML:

<div class="container">
    <div class="name">James</div>
    <div>Rodriguez</div>
    <div class="image">
        <div><img src="https://example.com/1.jpg"></div>
    </div>
</div>
<div class="container">
    <div class="name">Harry</div>
    <div>Kane</div>
    <div class="image">
        <div><img src="https://example.com/2.jpg"></div>
    </div>
</div>

How do I loop through all containers and get name, surname (second div) and image URL (img src)? So far I came up with this:

items = []

containers = driver.find_elements_by_xpath('//div[@class="container"]')

for items in containers:
    name = items.find_element_by_xpath('//div[@class="name"]')
    print(name.text)

This should give two names. However, I'm getting 'James' twice as output, and no 'Harry'.

Thanks!

It's there: how do I loop through all containers and get name, surname (second div) and image URL (img src)? — Mikel
– Mikel, Commented Feb 11, 2018 at 19:29

Andersson · Accepted Answer · 2018-02-11 19:22:37Z

9

Try below solution to get required values

for item in containers:
    name = item.find_element_by_xpath('.//div[@class="name"]')
    surname = name.find_element_by_xpath('./following-sibling::div')
    image = surname.find_element_by_xpath('./following::img')
    print(name.text, surname.text, image.get_attribute('src'))

answered Feb 11, 2018 at 19:22

Andersson

52.8k18 gold badges83 silver badges132 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

famfamfam Over a year ago

hi can you explain more? I dont know why use ./following-sibling::div and './following::img'

Guy · Accepted Answer · 2018-02-11 19:22:01Z

8

When using // you are starting the search from the root node (<html>). Use . before the xpath to start the search from the element location

for items in containers:
    name = items.find_element_by_xpath('.//div[@class="name"]')
    print(name.text)

answered Feb 11, 2018 at 19:22

Guy

51.2k10 gold badges49 silver badges96 bronze badges

1 Comment

Mikel Over a year ago

Thanks, it indeed was the case. I chose Andersson's anwer as it was a bit more elaborate in terms of finding other items.

Collectives™ on Stack Overflow

Loop through divs inside div in Selenium/Python

2 Answers 2

1 Comment

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related