navigate through hyperlinks in python selenium

Question

This is the website of skyscanner. After selecting flight I want to click on every 'Select button'(for $687) and then go to next page. On next page I want to click down arrow for outbound flight. Then I again I want to click select button ($715) and the again outbound flight arrow. So it goes in loop for all possible searches on all the pages possible.

This is how Downward arrow on next page is

Here is the code I have written so far :

driver = webdriver.Chrome( )

driver.get('https://www.skyscanner.com/transport/flights/nyca/lax/170717/170718/airfares-from-new-york-to-los-angeles-international-in-july-2017.html?adults=1&children=0&adultsv2=1&childrenv2=&infants=0&cabinclass=economy&rtn=1&preferdirects=false&outboundaltsenabled=false&inboundaltsenabled=false&ref=home#results')

while True:
        items=driver.find_element_by_class_name("fss-bpk-button expand-cba select-action")
        for i, item in enumerate(items):
            driver.find_element_by_class_name("fss-bpk-button expand-cba select-action").click()
              for j, item2 in item
                  driver.find_element_by_class_name("leg-summary-container clearfix").click()

I also tried following but none worked:

 links = [link.get_attribute('href') for link in driver.find_element_by_class_name("fss-bpk-button expand-cba select-action")]
    for link in links:
        driver.get(link)

Andersson · Accepted Answer · 2017-07-17 20:33:27Z

0

Your second code should work after some changes:

links = [link.get_attribute('href') for link in driver.find_elements_by_css_selector("a.fss-bpk-button.expand-cba.select-action")]

Note that

To get list of elements you should use find_elements_...() instead of find_element_...()
Compound class names not allowed, so you might use search by CSS selector or XPath instead of search by class name if you want to use multiple class names to locate required elements

answered Jul 17, 2017 at 20:33

Andersson

52.8k18 gold badges83 silver badges132 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Analyst Over a year ago

Thank you so much ! I am completely new to python so learning a lot! How should I loop it between the pages ? I don't understand it

Andersson Over a year ago

In the same way you tried: for link in links: driver.get(link)... You got the list of links. You can navigate to each page to make required actions in a loop\

Collectives™ on Stack Overflow

navigate through hyperlinks in python selenium

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related