how to click on a link that loads ajax data using selenium and python

Question

I am trying to extract some data from a site which loads the data using ajax and I am using selenium along with python for this.I want to click on a link which appears after an ajax page load. I have even put sleep function of python so that the page loads completely, but still not able to click. This error comes every time "selenium.common.exceptions.NoSuchElementException: Message: no such element".Please see the following code which I have written. Thanks

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.support.ui import WebDriverWait
import time
import subprocess
from selenium.webdriver.chrome.options import Options

chromeOptions = webdriver.ChromeOptions()
prefs = {"download.default_directory" : "C:/Users/212553509/Desktop/WHO"}
chromeOptions.add_experimental_option("prefs",prefs)
chromedriver = "C:/python27/Scripts/chromedriver.exe"
driver = webdriver.Chrome(executable_path=chromedriver, chrome_options=chromeOptions)
driver.get("http://apps.who.int/gho/data/node.home")
time.sleep(20)
driver.find_element_by_link_text('node.main.484?lang=en').click()

Ben C · Accepted Answer · 2016-03-01 11:34:11Z

1

You need to use a WebDriverWait so that Selenium has a chance to repeatedly poll the page to look for your element:

http://selenium-python.readthedocs.org/waits.html

answered Mar 1, 2016 at 11:34

Ben C

4865 silver badges16 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Shubham Goyal Over a year ago

Thanks.. but the wait isn't working either. The table is not visible on the source code itself.

Alexander Lazarov · Accepted Answer · 2016-03-01 11:34:21Z

0

You are passing the link href, not the link text to driver.find_element_by_link_text. If you have HTML code like this

<a target="_top" href="node.main.MEDSMDG8?lang=en">Essential medicines</a>

Use driver.find_element_by_text('Essential medicines')

answered Mar 1, 2016 at 11:34

Alexander Lazarov

5785 silver badges13 bronze badges

2 Comments

Shubham Goyal Over a year ago

Thanks! but I tried this also. can you suggest any other libraries using which I can fetch the data which is visible on the page but not in the source code

Alexander Lazarov Over a year ago

You can try scraperJs - I find it a lot easier to use compared to Python + Selenium.

Collectives™ on Stack Overflow

how to click on a link that loads ajax data using selenium and python

2 Answers 2

1 Comment

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related