Web scraping using Python and Selenium [duplicate]

Question

I am using the following code to submit a form using Python. When the value entered is correct, it redirects to a new page called http://localhost/a/my.php. How do i check whether the page is redirected using python so that I can know that the values entered where correct.

from selenium import webdriver

webpage = r"http://localhost/a/"
driver = webdriver.Chrome("C:\chromedriver_win32\chromedriver.exe")
for i in range(10):
    searchterm = i # edit me
    driver.get(webpage)
    sbox = driver.find_element_by_class_name("txtSearch")
    sbox.send_keys(searchterm)

    submit = driver.find_element_by_class_name("sbtSearch")
    submit.click()

You could use the driver.current_url to confirm it is the address you are looking for. If it does not work, maybe you have to wait for a page load, just add a time.sleep(x) or something. — Pax Vobiscum
– Pax Vobiscum, Commented Nov 17, 2017 at 9:14

Corey Goldberg · Accepted Answer · 2018-09-01 23:52:12Z

1

locate an element that only exists after the new DOM is loaded. If you can find it, you are on the new page.

try:
    driver.find_element_by_class_name("txtSearch")
    print("redirected to new page")
except NoSuchElementException:
    print("oops, no redirect happened")

edited Sep 1, 2018 at 23:52

Corey Goldberg

61.5k30 gold badges135 silver badges148 bronze badges

answered Nov 17, 2017 at 8:56

Prakash Palnati

3,43927 silver badges36 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Andersson Over a year ago

If navigation to new page failed el = driver.find_element_by_class_name("txtSearch") should give you NoSuchElementException

Prakash Palnati Over a year ago

Downvote?? May i know why?

Andersson Over a year ago

I've already clarified. Your first approach is not efficient as script should break with exception if new page is not opened

Corey Goldberg Over a year ago

just edited to catch NoSuchElementException instead of using is_displayed().

Mahesh Karia · Accepted Answer · 2017-11-17 08:54:48Z

0

Try using current_url:

driver.current_url

answered Nov 17, 2017 at 8:54

Mahesh Karia

2,0551 gold badge14 silver badges24 bronze badges

Comments

Corey Goldberg · Accepted Answer · 2018-09-01 23:26:52Z

0

to check whether the page is redirected properly or not, use a WebDriverWait (aka "explicit wait") with proper expected_conditions clause set to one of the following:

Python :

url_to_be :

WebDriverWait(driver, 10).until(EC.url_to_be("https://www.google.co.in/"))

url_matches :

WebDriverWait(driver, 10).until(EC.url_matches("https://www.google.co.in/"))

url_contains :

WebDriverWait(driver, 10).until(EC.url_contains("google"))

url_changes :

WebDriverWait(driver, 10).until(EC.url_changes("https://www.google.co.in/"))

edited Sep 1, 2018 at 23:26

Corey Goldberg

61.5k30 gold badges135 silver badges148 bronze badges

answered Nov 17, 2017 at 12:57

undetected Selenium

194k44 gold badges304 silver badges387 bronze badges

Collectives™ on Stack Overflow

Web scraping using Python and Selenium [duplicate]

3 Answers 3

4 Comments

Comments

Python :

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

4 Comments

Comments

Python :

Comments

Linked

Related