Extracting data from a script using XPath

Question

I do not manage to extract the thumbnail link with xpath in the following script/json:

<script type="application/ld+json">{"@context":"https://schema.org","@type":"VideoObject","name":"XYZ","description":"Text","thumbnailUrl":"https://www.thumbnail.com/thumb.jpg","uploadDate":"2000-01-01","contentUrl":"https://www.example.com"}</script>

I need the thumbnail link (https://www.thumbnail.com/thumb.jpg) after "thumbnailUrl", but do not know how the selector would follow after

//script[@type="application/ld+json"]/...

Please help.

If your XPath processor supports XPath 3.1, then parse-json(//script[@type="application/ld+json"])?thumbnailUrl would do. — Reino
– Reino, Commented Apr 23, 2022 at 18:38

Luuk · Accepted Answer · 2022-04-23 19:04:23Z

2

when the you have a file name "script.html" with the content:

<script type="application/ld+json">{"@context":"https://schema.org","@type":"VideoObject","name":"XYZ","description":"Text","thumbnailUrl":"https://www.thumbnail.com/thumb.jpg","uploadDate":"2000-01-01","contentUrl":"https://www.example.com"}</script>

then:

xidel -s -e "//script[1]"  script.html  >temp.json
xidel -s -e '$json."thumbnailUrl"' temp.json

should output:

https://www.thumbnail.com/thumb.jpg

tested with: Xidel 0.9.8 (on Windows)

EDIT:

It is also possible in one step

xidel -s -e "json(//script)/thumbnailUrl"  script.html

edited Apr 23, 2022 at 19:04

answered Apr 23, 2022 at 15:28

Luuk

15.4k5 gold badges28 silver badges44 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Reino Over a year ago

There's no need for a temporary file when you can do: xidel -s input.htm -e "json(//script[@type='application/ld+json'])/thumbnailUrl". And for the latest xidel release that's parse-json().

Luuk Over a year ago

@Reino: I was not able to get an example using parse-json() working. Probablu because of the mixed html/json

Reino Over a year ago

parse-json() will only work with v0.9.9.

Collectives™ on Stack Overflow

Extracting data from a script using XPath

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related