Click 'onclick' button with selenium and Python

Question

I need to scrap some information from this page.

However, the page needs the age confirmation before entering it. It has a button which must be clicked before the page can be seen. My problem is that my methods to click this button simply does not work.

Im using selenium and Python 2.7.10.

Here's my code:

def download_specific_page(url):
    try:
        browser = get_browser()
        wait = WebDriverWait(browser, 30)
        browser.get(main_page_url)
        time.sleep(2)
        buttons = browser.find_elements_by_class('close')
        for button in buttons:
            onclick_text = button.get_attribute('onclick')
            if onclick_text and re.search('ConfirmAge();', onclick_text):
                print "found it!"
                button.click()
        browser.get(url)
        html = browser.page_source
        browser.close()
        return html
    except Exception:
        info = 'Generic exception\n'
        return ""

I also tried with xpath, but still, no success:

def download_specific_page(url):
    try:
        browser = get_browser()
        wait = WebDriverWait(browser, 30)
        browser.get(main_page_url)
        button = browser.find_element_by_xpath("/html/body/div#bg_image/div.container/div#content/div#confirmage/div.confirmage_navigation/button.close[1]")
        button.click()
        time.sleep(2)
        browser.get(url)
        html = browser.page_source
        browser.close()
        return html
    except Exception:
        info = 'Generic exception\n'
        return ""

Any ideas how to click this button so I can scrap the page?

drets · Accepted Answer · 2015-12-21 21:31:37Z

2

Use regular click:

from selenium import webdriver

URL = 'https://www.24dolores.pl/pl/ogloszenia-towarzyskie'
CSS_SELECTOR = '.close'

browser = webdriver.Chrome()
browser.implicitly_wait(10)
browser.get(URL)
close = browser.find_element_by_css_selector(CSS_SELECTOR)
close.click()

edited Dec 21, 2015 at 21:31

answered Dec 12, 2015 at 11:00

drets

2,8252 gold badges26 silver badges38 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

darias Over a year ago

No, I use Firefox, but it works, thanks :) (I made a silly mistake, I don't use Chromium ;)

darias Over a year ago

When I was running the example, I used Linux. Now trying it on Windows, I'm getting the message Unable to find element with css selector 'close'

drets Over a year ago

@darias I updated answer, it might be a waiting issue - I added an implicit wait and make sure that the window is appearing...

Collectives™ on Stack Overflow

Click 'onclick' button with selenium and Python

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related