scraping youtube with selenium python

Question

I want to scrape the first two videos from the youtube search result, I have a list of words in CSV file I want to get the first two videos for each query, I tried to use selenium python but I get the error , so there is any way to do that.

CODE:

search_input = driver.find_element_by_css_selector('#search').send_keys('')

ERROR:

selenium.common.exceptions.ElementNotInteractableException: Message: element not interactable

I would rather call youtube.com/results?search_query=<SEARCH-TERM> instead of using search bar. — Arount
– Arount, Commented Jun 19, 2020 at 8:09
Best way to scrape could be to use its api. Please take a look at it — Ravi
– Ravi, Commented Jun 19, 2020 at 8:58

frianH · Accepted Answer · 2020-06-19 08:26:55Z

1

There are more than one element when using your selector #search.

.find_element_by_* refers to the first element, sadly the input element you are referring to is not the first. The first element with your selector is a hidden element, that's what causes you to get the .....element not interactable error.

A unique locator for that is input#search:

driver.find_element_by_css_selector('input#search').send_keys('test')

edited Jun 19, 2020 at 8:26

answered Jun 19, 2020 at 8:17

frianH

7,5916 gold badges26 silver badges49 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

scraping youtube with selenium python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related