Python.Selenium. Can't find existing element. How switch frame

Question

I wand to get feedbacks from page url = 'https://ru.aliexpress.com/store/product/Gillette-Fusion-blade-4-pc/2671035_1000003578539.html?spm=2114.12010612.0.0.xL0ySy'

I wait until page loaded. And I can find elements using Google Chrome inspector. But selenium can't find elements. And I alse can't find elements at the source page.

How can i get feedbacks using selenium or other instruments?

Here is my code:

from selenium import webdriver
import time
import csv
import requests

url = 'https://ru.aliexpress.com/store/product/Gillette-Fusion-blade-4-pc/2671035_1000003578539.html?spm=2114.12010612.0.0.xL0ySy'
driver = webdriver.Chrome()
driver.get(url)

try:
    close_popup = driver.find_element_by_class_name('close-layer')
    close_popup.click()
except:
    print("no alert")


tab_feedback = driver.find_element_by_xpath('//*[@id="j-product-tabbed-pane"]/ul/li[2]')
tab_feedback.click()
time.sleep(8)
try:
    text_feedback = driver.find_element_by_xpath('//*[@id="transction-feedback"]/div[4]/div[1]/div[2]/div[3]/dl')
    print(text_feedback.text)
except:
    print("cant find by xpath")

try:
    text_feedback = driver.find_element_by_class_name('buyer-feedback')
    print(text_feedback.text)
except:
    print("cant find by class_name")


try:
    text_feedback = driver.find_element_by_css_selector('div.f-content.dl.dt.span')
    print(text_feedback.text)
except:
    print("cant find by css_selector")

it returns:

cant find by xpath
cant find by class_name
cant find by css_selector

Andersson · Accepted Answer · 2017-03-29 09:54:05Z

2

You can try to add ExcplicitWait as below to wait for presence of required element:

from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.support.ui import WebDriverWait as wait

text_feedback = wait(driver, 10).until(EC.presence_of_element_located((By.CLASS_NAME, "buyer-feedback"))).text

Also note that element located inside an iframe, so you should switch to it first before handling embedded elements:

driver.switch_to.frame(driver.find_element_by_xpath('//iframe[starts-with(@src, "//feedback.aliexpress.com/display/productEvaluation.htm")]'))

To switch back from iframe:

driver.switch_to.default_content()

As for your selectors:

You should avoid using XPath expressions like //*[@id="transction-feedback"]/div[4]/div[1]/div[2]/div[3]/dl, but use more verbose relative XPath, like //dl[@class="buyer-feedback"] instead
CSS selector div.f-content.dl.dt.span should match element <div class="f-content dl dt span">. Note that you should use space to point on descendant element (div dt) and ">" to point on direct child (div>dl). Your CSS selector might looks like div.f-content>dl>dt>span or div.f-content dt>span...

edited Mar 29, 2017 at 9:54

answered Mar 29, 2017 at 9:26

Andersson

52.8k18 gold badges83 silver badges132 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Viktor Demin Over a year ago

it raise TimeoutException(message, screen, stacktrace). I am sure that problem not in speed of selenium. I tried to wait several minutes and looping requests. But it still doesn't find elements

Andersson Over a year ago

Yes. It located inside iframe. Check updated answer

Viktor Demin Over a year ago

Thanks, i got it =). Only one question. Where did you find xpath of Iframe?

Andersson Over a year ago

Just check ancestors and you'll find

<iframe scrolling="no" marginwidth="0" marginheight="0" src="//feedback.aliexpress.com/display/productEvaluation.htm?productId=1000003578539&ownerMemberId=825321852&companyId=&memberType=seller&startValidDate=" width="100%" height="1910" frameborder="0">

. I don't use tools for generating XPath. If you want to write your own XPath expressions, you might check tutorialspoint.com/xpath/xpath_overview.htm

Seif · Accepted Answer · 2017-03-29 09:13:59Z

0

And I also can't find elements at the source page.

This is OK since lots of modern websites uses dynamically loaded content and AJAX and JS frameworks. The source page is just the initial DOM nothing is added.

However the inspector refreshes its DOM. You should look for how to find dynamically added element to DOM.

answered Mar 29, 2017 at 9:13

Seif

1,09711 silver badges19 bronze badges

2 Comments

Viktor Demin Over a year ago

I always thought that selenium can handle Ajax. It can work like real user

Seif Over a year ago

Maybe selenium is too quick, check answer below or implement a retry mechanism (loop, sleep, retry, sleep more, retry, etc)

Collectives™ on Stack Overflow

Python.Selenium. Can't find existing element. How switch frame

2 Answers 2

4 Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

4 Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related