Python Scrapy selector for text elements between tags

Question

I need to write a selector in Python Scrapy.

I want to get % of CBD and % of THC.

test = productResponse
    .css('.woocommerce-product-details__short-description > p')[1]
    .get()

When I trying to do something like this i get result:

<p>
    <strong>CBD:</strong> 7.5%<br>
    <strong>THC:</strong><0.2%<br>
    <strong>Waga:</strong> 1 gram
</p>

But when I add the ::text I get only the value of CBD:

test = productResponse
    .css('.woocommerce-product-details__short-description > p::TEXT')[1]
    .get()

Result:

7.5%

How can I get value from Strong and second text value?

Does this answer your question? How to select all children text but excluding a tag with Scapy's XPath? — Eloims
– Eloims, Commented Dec 12, 2020 at 23:52
@Eloims, Sorry but that doesn't fix my issue. I have problem with tags not with excluding classes. — Zackk
– Zackk, Commented Dec 13, 2020 at 0:04

gangabass · Accepted Answer · 2020-12-13 09:35:58Z

2

You don't need classes here. I strongly recommend switching to XPath:

cbd = response.xpath('//strong[.="CBD:"]/following-sibling::text()[1]').get()
thc = response.xpath('//strong[.="THC:"]/following-sibling::text()[1]').get()

answered Dec 13, 2020 at 9:35

gangabass

10.7k2 gold badges26 silver badges36 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Python Scrapy selector for text elements between tags

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related