How to get text with Selenium WebDriver in a For Loop Python

Question

I'm trying to run a for loop in a website table with Selenium. I'm using Xpath to get the data.

When I run this solo, I get the proper output:

driver.find_element_by_xpath('//*[@id="top-team-stats-summary-content"]/tr[1]/td[2]').text

But when I put in a for loop to extract all values, it runs an error

vals = (list(np.arange(0,20,1)))
for i in vals :
    print(driver.find_element_by_xpath('//*[@id="top-team-stats-summary-content"]/tr[i]/td[2]').text)

Error:

NoSuchElementException: Message: no such element: Unable to locate element:
 {"method":"xpath","selector":"//*[@id="top-team-stats-summary-content"]/tr[i]/td[2]"}

This is the HTML

<td class="goal   ">59</td>

Any thoughts?

EDIT: Before coming to a post, I looked at this post, that helped me a lot.

Prophet · Accepted Answer · 2021-04-14 21:39:28Z

1

You have to pass the i parameter into the xpath expression.

xpath = '//*[@id="top-team-stats-summary-content"]/tr[{}]/td[2]'.format(i)
print(driver.find_element_by_xpath(xpath).text)

or simply concatenate the i value as suggested by groeterud

answered Apr 14, 2021 at 21:39

Prophet

33.5k28 gold badges58 silver badges90 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Rodrigo Brust Over a year ago

Thank you! It just solved my problem. It was a silly one, how could I miss that. I appreciate!

groeterud · Accepted Answer · 2021-04-14 21:36:02Z

1

You are very close mate. You simply need to concatonate your variable i within the string.

vals = (list(np.arange(0,20,1)))
for i in vals :
    print(driver.find_element_by_xpath('//*[@id="top-team-stats-summary-content"]/tr['+i+']/td[2]').text)

answered Apr 14, 2021 at 21:36

groeterud

1371 silver badge7 bronze badges

2 Comments

Rodrigo Brust Over a year ago

Hey! Thanks for the help! unfortunetly I got this error: TypeError: can only concatenate str (not "numpy.int32") to str

groeterud Over a year ago

right.. you have to convert it to a string within the forloop. Anyway, saw that the above answer worked for you, so that's great :)

Collectives™ on Stack Overflow

How to get text with Selenium WebDriver in a For Loop Python

2 Answers 2

1 Comment

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related