Scrapy : Unable to extract attribute field using css selector

Question

Here is the HTML code

<!DOCTYPE html>
<html lang="en">
<div class="container" id="content-area">
    <div class="flex-row flex-baseline flex-space-between" data-id="1826" id="info">
      <h1 class="no-margin">XYZ</h1>
        <div class="new-stack" id="sublists">Added</div>
    </div>
</div>

I am looking to pull the data-id attribute inside div tag. Here is what I am trying using CSS Selector

>>> response.css("#content-area div")[0].css("::attr[data-id]").get()

And I got below error

cssselect.parser.SelectorSyntaxError: Got pseudo-element ::attr not at the end of a selector

Here is how I solved it by combining CSS and XPATH Selectors.

>>> response.css("#content-area div")[0].xpath("@data-id").get()
'1826'

Is there any solution which can do this using just CSS Selector?

Tarun Lalwani · Accepted Answer · 2020-05-29 12:28:22Z

1

You need to use () instead of []

>>> response.css("#content-area div")[0].css("::attr(data-id)").get()

answered May 29, 2020 at 12:28

Tarun Lalwani

147k11 gold badges217 silver badges278 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Scrapy : Unable to extract attribute field using css selector

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related