Extract first element in the class using selenium

Question

This search gives the result and there are multiple pincodes present. I only need to capture the first element in the class.

code :

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from bs4 import BeautifulSoup
import re
import pandas as pd
import os
import html5lib
import json
import time
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.keys import Keys
url = "https://www.google.com/"
chromedriver = r"C:\Users\me\chromedriver"
driver = webdriver.Chrome(chromedriver)
driver.implicitly_wait(30)
driver.get(url)
search = driver.find_element_by_name('q')
search.send_keys("newyork pincode")
search.send_keys(Keys.RETURN) 



time.sleep(5) 
driver.quit()

Finding the class with the name h998We mlo-c and getting the first element will give you the first pin code. — Sundeep
– Sundeep, Commented Sep 3, 2019 at 8:17
@thoris answer updated wit a bit explanation, hope helps more. — frianH
– frianH, Commented Sep 5, 2019 at 5:18

frianH · Accepted Answer · 2019-09-05 05:07:51Z

2

You can use css selector or xpath to achieve.

Css Selector *recommended
```
div.IAznY div.title
```

Xpath

//div[@class="IAznY"]//div[@class="title"]

Add WebDriverWait instead time.sleep(..) for effeciency.

First you need following import:

from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions

note: find_element_by_* always return the first element, even if there are many elements with the same locator.

So you can use the bellow code:

search = driver.find_element_by_name('q')
search.send_keys("newyork pincode")
search.send_keys(Keys.RETURN)

element = WebDriverWait(driver, 10).until(expected_conditions.visibility_of_element_located((By.CSS_SELECTOR, 'div.IAznY div.title')))
print(element.text)

But if you need handle multiple like you say and you want not the first element, then you can use .find_elements_by_*. The code below is an example to get the second element:

elements = WebDriverWait(driver, 10).until(expected_conditions.visibility_of_all_elements_located((By.CSS_SELECTOR, 'div.IAznY div.title')))
print(elements[1].text)

This is index [1], and you can see the difference between the first code and the second code in the WebDriverWait implementation, namely visibility_of_element_located andvisibility_of_all_elements_located

edited Sep 5, 2019 at 5:07

answered Sep 3, 2019 at 8:29

frianH

7,5916 gold badges26 silver badges49 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

JeffC Over a year ago

If you just want the first element, there's no reason to use .find_elements_*(), just use .find_element_*(). Also, the WebDriverWait() statement above returns the waited for element. By waiting and then doing another find elements, you are hitting the page twice. I've edited your answer to show you the streamlined way to do this.

JeffC Over a year ago

I would argue (and it has been proven) that CSS selectors are faster than XPath. Given this locator doesn't require XPath, you can easily convert it to div.IAznY div.title, which is also much shorter and more readable (I think). I'll let you edit that in, if you want, because I feel it deviates too much from your intended answer for me to do.

frianH Over a year ago

Thanks very much, agree what you have done, very clear for me. You are one of the best stackoverflow users in the selenium class.

KunduK · Accepted Answer · 2019-09-03 08:42:33Z

0

Induce WebDriverWait and Following Css Selector to identify the element.

elements=WebDriverWait(driver, 10).until(EC.visibility_of_all_elements_located((By.CSS_SELECTOR, 'div.mlo-c div.title')))
print(elements[0].text)

Printed on console:

You need to import followings to execute above code.

from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

answered Sep 3, 2019 at 8:42

KunduK

33.4k5 gold badges19 silver badges42 bronze badges

Comments

Sundeep · Accepted Answer · 2019-09-03 08:23:19Z

-1

Finding the class with the name h998We mlo-c and getting the first element will give you the first pin code.

find_element_by_class_name('h998We mlo-c') and it will return you all the pin codes for any city such as Delhi which you were asking earlier, and then get the text inside the div to get the Pincode

https://selenium-python.readthedocs.io/api.html#selenium.webdriver.remote.webdriver.WebDriver.find_element_by_class_name

answered Sep 3, 2019 at 8:23

Sundeep

2,5053 gold badges23 silver badges48 bronze badges

3 Comments

user11669928 Over a year ago

Message: no such element: Unable to locate element: {"method":"css selector","selector":".h998We mlo-c"}

JeffC Over a year ago

find_element_by_class_name() expects a single class name and you are sending it two. This will cause an error.

Sundeep Over a year ago

Got it let me rewrite my solution.

Collectives™ on Stack Overflow

Extract first element in the class using selenium

3 Answers 3

3 Comments

Comments

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

3 Comments

Comments

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related