Python: Selenium send_key not working

Question

I am trying to use Selenium in Python, as as I am a beginner in doing so I cannot get send_key to work, but most probably it is straight forward and I am missting something.

Here is an example of what I have done so far:

from selenium import webdriver

driver = webdriver.Firefox()
driver.get("https://semantria.com/demo")
item = driver.find_element_by_id("analyze_url_form")
item.send_keys("http://finance.yahoo.com/news/skystar-bio-pharmaceutical-company-provides-133000048.html")
go_button = driver.find_element_by_id("analyze_url_button")
go_button.click()

The idea is that in the https://semantria.com/demo website, there is an empty space that one can enter a website link, and then click on the Go button. However, it looks like my code does not do this.

Am I doing something wrong? Does this website do something that I should be aware of and change my code accordingly? Any help on this is really appreciated.

alecxe · Accepted Answer · 2015-10-10 03:18:43Z

3

The problem is that you are sending keys to the form element, not the input element inside.

Plus, you can just send the URL with a new line at the end which is the same as you've entered the URL and pressed ENTER key which results in the form being submitted. Works for me:

item = driver.find_element_by_css_selector("form#analyze_url_form input[name=link]")
item.send_keys("http://finance.yahoo.com/news/skystar-bio-pharmaceutical-company-provides-133000048.html" + "\n")

As a bonus, here is how you can grab the sentiment value (you have to let selenium know what to wait for via WebDriverWait and Expected Conditions):

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.wait import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC


driver = webdriver.Firefox()
driver.get("https://semantria.com/demo")

item = driver.find_element_by_css_selector("form#analyze_url_form input[name=link]")
item.send_keys("http://finance.yahoo.com/news/skystar-bio-pharmaceutical-company-provides-133000048.html" + "\n")

wait = WebDriverWait(driver, 30)

sentiment_value = wait.until(EC.visibility_of_element_located((By.CSS_SELECTOR, "strong.sentiment_score_value")))
print(sentiment_value.text)

Prints positive (+0.230).

edited Oct 10, 2015 at 3:18

answered Oct 10, 2015 at 3:10

alecxe

476k127 gold badges1.1k silver badges1.2k bronze badges

Sign up to request clarification or add additional context in comments.

7 Comments

TJ1 Over a year ago

Fantastic, it worked nicely. Can you please tell me now how to look at the content that webpage returns?

TJ1 Over a year ago

thanks. Where is the whole content of webpage not just the sentiment value?

alecxe Over a year ago

@TJ1 if you need the complete content, right after the wait is done (meaning the results are now loaded), get the driver.page_source. Hope that helps.

TJ1 Over a year ago

Thanks alecxe yes that was very helpful I really appreciate it.

TJ1 Over a year ago

Thanks alecxe. Here is the new question: stackoverflow.com/questions/33062149/…

|

Collectives™ on Stack Overflow

Python: Selenium send_key not working

1 Answer 1

7 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

7 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related