Selenium WebDriverWait returns an error on Python while web scraping

Question

I am creating a script for Facebook scraping. I am using Selenium 2.53.6, Gecko driver 0.11.1 with Firefox 50 under Ubuntu 14.04.5 LTS. I have also tried it under Windows 10 using Gecko as well as Chromedriver too, with the same results (that I will describe below) :(

The following code fragment I use that I copied from the original documentation in section Explicitly Waits is:

import datetime, time, sys, argparse
from time import strftime
from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.firefox.firefox_binary import FirefoxBinary
from selenium.webdriver.support.ui import WebDriverWait # available since 2.4.0
from selenium.webdriver.support import expected_conditions as EC # available since 2.26.0
...
...
def main(usrEmail, pwd, numberOfScrolls, secondsWait, searchItem, outFilename):
    # Open Firefox Browser
    binary = FirefoxBinary('/usr/bin/firefox')
    browser = webdriver.Firefox(firefox_binary=binary)
    
    #put browser in specific position
    browser.set_window_position(400, 0)

    # goto facebook
    browser.get("http://www.facebook.com")
    
    #waiting( 5 )
    try:
        element = WebDriverWait(browser, 10).until(EC.presence_of_element_located((By.ID, "u_0_p")))
    finally:
        logging("logging in...")

The problem is that I get this error:

  File "fb.py", line 86, in main
    element = WebDriverWait(browser, 10).until(EC.presence_of_element_located((By.ID, "u_0_p")))
NameError: name 'By' is not defined

As a workaround I am just using delays in a form time.sleep( delay ) and the program works pretty nice, but it would be better if I had the WebDriverWait feature.

Do I miss something obvious or it is a kind of selenium bug or a web browser feature? Any help / clarification will be greatly appreciated!

Thanks for your time!!

I've had similar problems. From what I've gathered, not all WebDrivers support the Explicitely.Wait feature. — Fang
– Fang, Commented Nov 20, 2016 at 10:02

Moshisho · Accepted Answer · 2016-11-20 12:50:18Z

2

Could be your missing the definition of By:

from selenium.webdriver.common.by import By

answered Nov 20, 2016 at 12:50

Moshisho

3,0411 gold badge25 silver badges43 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Andreas Venieris Over a year ago

Well... embarrassing (as obvious) solutions are very common to a every new programming challenge!! :-) Thank you so much @Moshisho... What misleading me, basically, was the original documentation, that skip this... detail!

Moshisho Over a year ago

If my answer has solved your problem, accepting it will be much appreciated!

Andreas Venieris Over a year ago

Apologies for the delay @Moshito... I just accept it!! ;-) Thank you!

Collectives™ on Stack Overflow

Selenium WebDriverWait returns an error on Python while web scraping

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related