Python selenium to select first element from the dropdown list

Question

The below piece of code clicks the file menu on a page which contain excel worksheet.

from selenium import webdriver
driver = webdriver.PhantomJS()
driver.set_window_size(1120, 550)
driver.get(r"foo%20Data%20235.xlsx&DefaultItemOpen=3") # dummy link
driver.find_element_by_css_selector('#jewel-button-middle > span').click() # responsible for clicking the file menu
driver.quit()

And I don't know how to click the first option ie, Download a snapshot option from the popup menu. I can't able to inspect the elements of pop up or dropdown menu. I want the xlsx file to get downloaded.

Could you share the actual link if possible? Or, could you dump the driver.page_source once you open this page on the screenshot and add the relevant part of the HTML (the menu with the "Download a Snapshot" link) to the question? Thanks. — alecxe
– alecxe, Commented Jan 11, 2017 at 4:36
@alecxe Hi.. here is the link cbe.org.eg/en/EconomicResearch/Publications/_layouts/… — Avinash Raj
– Avinash Raj, Commented Jan 18, 2017 at 8:42

alecxe · Accepted Answer · 2017-01-24 15:35:35Z

2

+50

The idea is to load the page with PhantomJS, wait for the contents of the workbook to load, get all the necessary parameters for the download file handler endpoint request which we can do with requests package.

Full working solution:

import json

import requests
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

WORKBOOK_TYPE = "PublishedItemsSnapshot"

driver = webdriver.PhantomJS()
driver.maximize_window()
driver.get('http://www.cbe.org.eg/en/EconomicResearch/Publications/_layouts/xlviewer.aspx?id=/MonthlyStatisticaclBulletinDL/External%20Sector%20Data%20235.xlsx&DefaultItemOpen=1#')

wait = WebDriverWait(driver, 10)
wait.until(EC.presence_of_element_located((By.ID, "ctl00_PlaceHolderMain_m_excelWebRenderer_ewaCtl_rowHeadersDiv")))

# get workbook uri
hidden_input = wait.until(EC.presence_of_element_located((By.ID, "ctl00_PlaceHolderMain_m_excelWebRenderer_ewaCtl_m_workbookContextJson")))
workbook_uri = json.loads(hidden_input.get_attribute('value'))['EncryptedWorkbookUri']

# get session id
session_id = driver.find_element_by_id("ctl00_PlaceHolderMain_m_excelWebRenderer_ewaCtl_m_workbookId").get_attribute("value")

# get workbook filename
workbook_filename = driver.find_element_by_xpath("//h2[contains(@class, 's4-mini-header')]/span[contains(., '.xlsx')]").text

driver.close()

print("Downloading workbook '%s'..." % workbook_filename)
response = requests.get("http://www.cbe.org.eg/en/EconomicResearch/Publications/_layouts/XlFileHandler.aspx", params={
    'id': workbook_uri,
    'sessionId': session_id,
    'workbookFileName': workbook_filename,
    'workbookType': WORKBOOK_TYPE
})
with open(workbook_filename, 'wb') as f:
    for chunk in response.iter_content(chunk_size=1024):
        if chunk: # filter out keep-alive new chunks
            f.write(chunk)

answered Jan 24, 2017 at 15:35

alecxe

476k127 gold badges1.1k silver badges1.2k bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Avinash Raj Over a year ago

Hi @alecxe. Thanks for your answer. Is there any way to use only phantomjs for upto the last step, ie. on clicking the download snapshot button using phantomjs, it has to get the download url and hand over the url to requests library?

alecxe Over a year ago

@AvinashRaj glad it worked for you. I believe that PhantomJS is not able to save downloads automatically. The download link is dynamically constructed, not sure if there is an easy way to get it instead of constructing it manually as we are currently doing..

Guy · Accepted Answer · 2017-01-19 09:14:21Z

2

It easier to inspect such elements (closing dropdowns) using FireFox, open the developer tools and just stand on the element with the mouse cruiser after selecting the option from FireBug toolbar (marked in red square in the picture).

As for the question, the locator you are looking for is ('[id*="DownloadSnapshot"] > span')

from selenium import webdriver
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

driver = webdriver.PhantomJS()
driver.set_window_size(1120, 550)
driver.get(r"foo%20Data%20235.xlsx&DefaultItemOpen=3") # dummy link

wait = WebDriverWait(driver, 10)

wait.until(EC.invisibility_of_element_located((By.CSS_SELECTOR, '[id*="loadingTitleText"]')))

driver.find_element_by_css_selector('#jewel-button-middle > span').click() # responsible for clicking the file menu

download = wait.until(EC.visibility_of_element_located((By.CSS_SELECTOR, '[id*="DownloadSnapshot"] > span')))
driver.get_screenshot_as_file('fileName')
download.click()

edited Jan 19, 2017 at 9:14

answered Jan 19, 2017 at 7:24

Guy

51.2k10 gold badges49 silver badges96 bronze badges

6 Comments

Guy Over a year ago

Note that it takes 1-2 seconds for the download to start, you might want to delay the driver.quit()

Avinash Raj Over a year ago

I tried to take screenshot once the driver clicked the file menu. BUt it fails to show the dropdown on the screenshot.

Avinash Raj Over a year ago

so it should wait until the element got visible within 10 sec, right?

Guy Over a year ago

@AvinashRaj Exactly. You can read here more about waits.

Guy Over a year ago

@AvinashRaj I edited my answer, you need to wait for the page to load before clicking on the file tab

|

Naveen Kumar R B · Accepted Answer · 2017-01-20 05:54:12Z

1

I observed the till the excel is completely loaded, File menu is not showing any options. So added wait till the excel book is loaded.

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from time import sleep
from selenium.webdriver.common.action_chains import ActionChains

browser = webdriver.PhantomJS()
browser.maximize_window()
browser.get('http://www.cbe.org.eg/en/EconomicResearch/Publications/_layouts/xlviewer.aspx?id=/MonthlyStatisticaclBulletinDL/External%20Sector%20Data%20235.xlsx&DefaultItemOpen=1#')

wait = WebDriverWait(browser, 10)
element = wait.until(EC.visibility_of_element_located((By.XPATH, "//td[@data-range='B59']")))
element = wait.until(EC.element_to_be_clickable((By.ID, 'jewel-button-middle')))
element.click()
eleDownload = wait.until(EC.element_to_be_clickable((By.XPATH,"//span[text()='Download a Snapshot']")))
eleDownload.click()
sleep(5)
browser.quit()

edited Jan 20, 2017 at 5:54

answered Jan 19, 2017 at 10:25

Naveen Kumar R B

6,4385 gold badges36 silver badges68 bronze badges

6 Comments

Naveen Kumar R B Over a year ago

increase timeout from 10 to 20 seconds in WebDriverWait if your internet speed is slow. I observed that it takes time for loading the excel.

Avinash Raj Over a year ago

oki, cool.. But I want this to get done through webdriver.PhantomJS

Naveen Kumar R B Over a year ago

just replace the line webdriver.Firefox() to webdriver.PhantomJS() rest is same.

Avinash Raj Over a year ago

your code seems like working on using firefox web driver but on phantom, it throws exception on line 13 .. How to get the file downloaded? Note that I'm using phantomjs ..

Naveen Kumar R B Over a year ago

use the following answer stackoverflow.com/a/18440478/2575259 to save the file automatically in Firefox browser. In PhantomJS, it seems to be an issue. more details github.com/ariya/phantomjs/issues/10052 & stackoverflow.com/questions/25755713/…

|

F.Moure · Accepted Answer · 2017-01-24 05:08:22Z

0

find the element by id/tag, inspect options in a loop, select the one you want then do the click.

answered Jan 24, 2017 at 5:08

F.Moure

611 silver badge4 bronze badges

Collectives™ on Stack Overflow

Python selenium to select first element from the dropdown list

4 Answers 4

2 Comments

6 Comments

6 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

2 Comments

6 Comments

6 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related