Extract text with a Python XPath expression

Question

I want to display http:///gb/groceries/easter-essentials--%28approx-205kg%29.

In scrapy I used this XPath expression:

response.xpath('//div[@class="productNameAndPromotions"]/h3/a/href').extract()

but it didn't work!

<div class="product ">
    <div class="productInfo">
        <div class="productNameAndPromotions">
            <h3>
                <a href="http:///gb/groceries/easter-essentials--%28approx-205kg%29">
                    <img src="http:co.uk/wcsstore7.20.1.145/ExtendedSitesCatalogAssetStore/image/catalog/productImages/08/020000008_L.jpeg" alt="" />
                </a>
            </h3>
        </div>        
    </div>
</div>

I completed your XML sample to be well-formed.

zx485
– zx485

2017-03-24 18:03:46 +00:00
Commented Mar 24, 2017 at 18:03 — zx485
– zx485, Commented Mar 24, 2017 at 18:03

Daniel Haley · Accepted Answer · 2017-03-24 18:02:48Z

1

This //div[@class="productNameAndPromotions"]/h3/a/href means you want to get element href which is child of a.

If you want to extract nodes' attribute, e.g. href, you need to use @attribute syntax. Try below:

//div[@class="productNameAndPromotions"]/h3/a/@href

edited Mar 24, 2017 at 18:02

Daniel Haley

53.1k7 gold badges75 silver badges97 bronze badges

answered Mar 24, 2017 at 17:56

Andersson

52.8k18 gold badges83 silver badges132 bronze badges

Sign up to request clarification or add additional context in comments.

9 Comments

Andersson Over a year ago

Can you share page URL?

user7741878 Over a year ago

thank you @anderson ! i found another solution , but i had another question aboutscrapy how can i convert the list of strings into floats i generated with (i tried many solutions but doesn't work): >>prices_unit = response.xpath('//p[@class="pricePerUnit"]/text()').extract() >>for title in titles: item["price_unit"] = prices_unit any help please

Andersson Over a year ago

If you get list of strings with prices_unit = response.xpath('//p[@class="pricePerUnit"]/text()').extract(‌) then you can simply get list of floats with prices_unit = [float(unit) for unit in prices_unit]

Andersson Over a year ago

But you said that prices_unit is list of strings, right? :) show how does it really looks like- what is output of print(prices_unit)?

user7741878 Over a year ago

It displays prices , if we print prices_unit {£2.00], £2.50, £1.00, £3.00 ...} and i made re.findall to print only numbers {2.00, 2.50, 1.00, 3.00}

|

Collectives™ on Stack Overflow

Extract text with a Python XPath expression

1 Answer 1

9 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

9 Comments

Your Answer

Sign up or log in

Post as a guest

Related