Slowly scroll in python selenium javascript

Question

url = correct_url(url)
browser = webdriver.Chrome()
browser.get(url)
browser.find_element_by_xpath('//*[@title="New chat"]').click()
drawer_body = browser.find_elements_by_class_name('drawer-body')
browser.execute_script('arguments[0].scrollTop = arguments[0].scrollHeight', drawer_body)

Get the 'div' element, this has a list and will be scrolled

drawer_body = browser.find_elements_by_class_name('drawer-body')

The line below scrolls very fast and reaches the bottom but this does not load data. Is there any way I can slowly scroll into drawer_body element?.

browser.execute_script('arguments[0].scrollTop = arguments[0].scrollHeight', drawer_body)

I am trying to implement the below script using python and selenium. http://ctrlq.org/code/19966-whatsapp-phone-numbers

When you scroll into the drawer_body element it makes a request to the server, you can fetch what request that is. Open the network tab and try to request the link manually and see what happens, if you provide the url I can take a look at it — Rafael Almeida
– Rafael Almeida, Commented Aug 4, 2016 at 17:28
I didn't get what you meant, I am new to these things. I want to scroll in web.whatsapp.com — Nilesh Chate
– Nilesh Chate, Commented Aug 6, 2016 at 10:05

vadimhmyrov · Accepted Answer · 2016-08-09 11:52:17Z

2

Most browsers support Spacebar key as a keyboard shortcut for scrolling page down. Using this feature, you can do the following:

Visit page
Parse what is loaded so far
Simulate press spacebar using Selenium
Wait 2-3 seconds till more data is loaded
Continue

One more hint: to avoid being stuck in a forever loop, you need to implement a check if the newly loaded data differs from the one before pressing spacebar, otherwise the script should quit, as there is no new data to parse.

answered Aug 9, 2016 at 11:52

vadimhmyrov

1897 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

yingdi fu · Accepted Answer · 2018-05-04 09:57:32Z

0

try this

drawer_body = browser.find_elements_by_class_name('drawer-body')
location = drawer-body.location
for i in range(location['x']//500):
    browser.execute_script('window.scrollBy(0, 500)')

answered May 4, 2018 at 9:57

yingdi fu

11 bronze badge

Comments

user19223910 · Accepted Answer · 2022-05-29 05:53:46Z

0

driver.execute_script('window.scrollBy(0, 500)')
driver.execute_script('window.scrollBy(0, 500)')
time.sleep(2)
driver.execute_script('window.scrollBy(0, 500)')
driver.execute_script('window.scrollBy(0, 500)')
time.sleep(2)
driver.execute_script('window.scrollBy(0, 500)')
driver.execute_script('window.scrollBy(0, 500)')
time.sleep(2)
driver.execute_script('window.scrollBy(0, 500)')
driver.execute_script('window.scrollBy(0, 500)')
time.sleep(2)
driver.execute_script('window.scrollBy(0, 500)')
time.sleep(1)

answered May 29, 2022 at 5:53

user19223910

111 bronze badge

Collectives™ on Stack Overflow

Slowly scroll in python selenium javascript

3 Answers 3

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related