Python click button on web page without selenium

Question

So there is a button on a webpage that downloads a csv file after clicking it. In the past I have used selenium to do this, but given the current application of this script being ran on databricks I'd rather not use a web driver. However, when I inspect the button I see no URL or a JS function call. Here is what the html looks like:

<button id="exportReport" class="button">
                    Export Report                   
                </button> == $0

I would link the webpage, but it requires a log in. Is there any way I can simulate clicking this button via requests, mechanize, or beautiful soup?

Use the Chrome dev tools > Network tab. Click on the CSV button and see where the CSV comes from. — Mike67
– Mike67, Commented Aug 17, 2020 at 22:08
Perfect! Nice little trick, was able to get the api endpoint from this — Marc
– Marc, Commented Aug 17, 2020 at 22:15

Mike67 · Accepted Answer · 2020-08-17 22:27:19Z

3

Copying my comment to the answer:

Use the Chrome dev tools (F12) > Network tab. Click the button on the web page to see where the CSV comes from:

answered Aug 17, 2020 at 22:27

Mike67

11.3k2 gold badges9 silver badges15 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

aKratos · Accepted Answer · 2020-08-30 13:55:16Z

0

try with mechanize:

import mechanize

br = mechanize.Browser()
br.set_handle_robots(False)
br.set_handle_equiv(False)
br.set_handle_refresh(False)
br.addheaders = [('User-agent', 'Mozilla/5.0')] 

url = 'https://www.your_url'
br.open(url, timeout=10.0)

# If exist any form
br.select_form(nr= 0)
br.form['name_of_form']=str('text_to_search')

# click on the button and saved it into a variable
data = br.submit()

Another way would be to try with Selenium, in case it is a javascript button:

data=browser.find_element_by_xpath("//input[@id='exportReport']")
data=browser.execute_script("arguments[0].click();", data)

I hope you have success.

answered Aug 30, 2020 at 13:55

aKratos

3131 silver badge12 bronze badges

Collectives™ on Stack Overflow

Python click button on web page without selenium

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related