Using Playwright for Python, how do I select (or find) an element?

Question

I'm trying to learn the Python version of Playwright. See here

I would like to learn how to locate an element, so that I can do things with it. Like printing the inner HTML, clicking on it and such.

The example below loads a page and prints the HTML

from playwright import sync_playwright

with sync_playwright() as p:
    browser = p.chromium.launch(headless=False)
    page = browser.newPage()
    page.goto('http://whatsmyuseragent.org/')
    print(page.innerHTML("*"))
    browser.close()

This page contains an element

<div class="user-agent">
    <p class="intro-text">Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4238.0 Safari/537.36</p>
</div>

Using Selenium, I could locate the element and print it's content like this

elem = driver.find_element_by_class_name("user-agent")
print(elem)
print(elem.get_attribute("innerHTML"))

How can I do the same in Playwright?

#UPDATE# - Note if you want to run this in 2021+ that current versions of playwright have changed the syntax from CamelCase to snake_case.

Upendra · Accepted Answer · 2021-09-27 10:41:08Z

10

The accepted answer does not work with the newer versions of Playwright. (Thanks @576i for pointing this out)

Here is the Python code that works with the newer versions (tested with version 1.5):

from playwright.sync_api import sync_playwright

with sync_playwright() as p:
    browser = p.chromium.launch()
    page = browser.new_page()
    page.goto('http://whatsmyuseragent.org/')
    ua = page.query_selector(".user-agent");
    print(ua.inner_html())
    browser.close()

To get only the text, use the inner_text() function.

print(ua.inner_text())

edited Sep 27, 2021 at 10:41

answered Sep 27, 2021 at 7:40

Upendra

7369 silver badges17 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

576i Over a year ago

At the time of writing the question, the accepted answer was working Python code. Since then, playwright has changed a bit and now uses a more Python friendly notation. (This is the case for many other older playwright questions)

Upendra Over a year ago

Got it. Thanks. I am editing this answer to reflect this.

hardkoded · Accepted Answer · 2020-10-11 11:53:46Z

7

You can use the querySelector function, and then call the innerHTML function:

handle = page.querySelector(".user-agent")
print(handle.innerHTML())

edited Oct 11, 2020 at 11:53

answered Oct 11, 2020 at 11:47

hardkoded

22k3 gold badges64 silver badges77 bronze badges

3 Comments

étale-cohomology Over a year ago

AttributeError: 'Page' object has no attribute 'querySelector'

Upendra Over a year ago

In Python, it would be page.query_selector(".user-agent)

576i Over a year ago

Note that playwright for python has changed the syntax from querySelector to query_selector for the newer versions... If you find other older, no-longer-working playwright answers, this is probably why.

crifan · Accepted Answer · 2021-03-31 09:18:22Z

3

according to Latest official python version Playwright, you should use:

page's query_selector
and element's inner_html

-> the code:

# userAgentSelector = ".user-agent"
userAgentSelector = "div.user-agent"
elementHandle = page.query_selector(userAgentSelector)
uaHtml = elementHandle.inner_html()
print("uaHtml=%s" % uaHtml)

answered Mar 31, 2021 at 9:18

crifan

14.5k2 gold badges83 silver badges67 bronze badges

Comments

ggorlen · Accepted Answer · 2023-08-26 19:50:05Z

3

Existing answers are a bit outdated. Nowadays the locator API is recommended since auto-waiting is the common case:

from playwright.sync_api import sync_playwright  # 1.37.0

with sync_playwright() as p:
    browser = p.chromium.launch()
    page = browser.new_page()
    page.goto("https://www.example.com")
    text = page.locator("h1").text_content()
    print(text)
    browser.close()

Use query_selector when you don't want to wait and instead want an immediate None if the element isn't visible.

_{Note that http://whatsmyuseragent.org is down, so I used a different site, but it's basically the same.}

edited Aug 26, 2023 at 19:50

answered Aug 26, 2023 at 18:04

ggorlen

59.3k8 gold badges119 silver badges173 bronze badges

Comments

freeboy2099 · Accepted Answer · 2023-01-14 10:27:23Z

0

I think you can find the solutions in the following article. Playwright >> Find, Locate, Select Elements/Tags using Playwright

Playwright find all elements/tags containing specified text
Playwright find elements/tags containing specified child element/tag
Playwright loop through all elements/tags in locator() result
Playwright find/get first element Playwright find/get last element
Playwright get the parent element Playwright get the child element
Playwright get nth child element Playwright find elements/tags by css
class Playwright find elements near the specified text Playwright
find elements/tags by attribute Playwright find elements/tags by id

answered Jan 14, 2023 at 10:27

freeboy2099

192 bronze badges

Collectives™ on Stack Overflow

Using Playwright for Python, how do I select (or find) an element?

5 Answers 5

2 Comments

3 Comments

Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

5 Answers 5

2 Comments

3 Comments

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related