WebScraping issues in python using Selenium

Question

I'm trying to scrape data from this website called Anhembi

But when I try all the options from selenium to find elements, I get nothing. Anyone know why this happens?

I've already tried:

driver.find_element_by_xpath('//*[@class="agenda_result_laco_box"]')

And made a for-loop through that to click in every single one and get the info I need which consists of the day, website and name of the events. How can I do that?

x = driver.find_element_by_name('month') print(range(len(x))) — Gustavo Molina
– Gustavo Molina, Commented Jul 30, 2018 at 16:36

cruisepandey · Accepted Answer · 2018-07-30 16:44:48Z

1

Clearly, there is an iframe involved , you need to switch the focus of your web driver in order to interact with elements which are in iframe/frameset/frame.

You can try with this code :

driver.get("http://www.anhembi.com.br/agenda/") 

driver.switch_to.frame(driver.find_element_by_css_selector("iframe[src='http://intranet.spturis.com.br/intranet/modulos/booking/anhembisite_busca.php']"))
all_data = driver.find_elements_by_css_selector("div.agenda_result_laco_box")

print(len(all_data))

for data in all_data:
  print(data.text)

answered Jul 30, 2018 at 16:44

cruisepandey

29.5k6 gold badges23 silver badges43 bronze badges

Sign up to request clarification or add additional context in comments.

5 Comments

Gustavo Molina Over a year ago

can u explain me whats's an iframe, please?

cruisepandey Over a year ago

iframe is basically , used to embed another document within the current HTML document. For more you can refer this : w3schools.com/tags/tag_iframe.asp

Gustavo Molina Over a year ago

and how could i get all info of the + simbol too?

cruisepandey Over a year ago

Didn't get you. all the info means ? With the above code you will get everything that is under Você buscou: JULHO DE 2018 and I don't know what +simbol is ?

cruisepandey Over a year ago

If you are talking about the + sign which is just preceded by date , then you will have to click on each + sign one by one and scrape the data.

Collectives™ on Stack Overflow

WebScraping issues in python using Selenium

1 Answer 1

5 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

5 Comments

Your Answer

Sign up or log in

Post as a guest

Related