How to use jquery selector on nested html

Question

This is my html:

<select id="my-select">
  <option value="1100">First option</option>
  <option value="1200">First option</option>
  <option value="1300">First option</option>
</select>

I am trying out scraperjs library to parse HTML. In their github page, there is this example:

var scraperjs = require('scraperjs');
scraperjs.StaticScraper.create('https://news.ycombinator.com/')
  .scrape(function($) {
    return $(".title a").map(function() {
        return $(this).text();
    }).get();
  })
  .then(function(news) {
    console.log(news);
  })

Then I try the same thing on my HTML but it does not work. I only change this:

var scraperjs = require('scraperjs');
scraperjs.StaticScraper.create('https://news.ycombinator.com/')
  .scrape(function($) {
    return $("#my-select option").map(function() {
      return $(this).attr("value");
    }).get();
  })
  .then(function(news) {
    console.log(news);
  })

What is wrong with my jquery selector?

you can directly get that all options, why you use that library, is there any reason? — Harsh Sanghani
– Harsh Sanghani, Commented Jun 4, 2016 at 7:14
Obviously, at time you initialoze the plugin, element select isnt available in DOM. Try using dynamic scraper instead — A. Wolff
– A. Wolff, Commented Jun 4, 2016 at 7:14
@A.Wolff is right you have to place these code in document ready or need to make some delay on script so the HTML will load completely. — Harsh Sanghani
– Harsh Sanghani, Commented Jun 4, 2016 at 7:16
@A.Wolff I changed to dynamic and added some timeout, but this time nothing is logged on console. — brainmassage
– brainmassage, Commented Jun 4, 2016 at 7:22

Paulo Ramos · Accepted Answer · 2017-11-21 17:09:22Z

1

You're still using the url(https://news.ycombinator.com/) from the example, replace the url to the html page you want to scrape:

var scraperjs = require('scraperjs');
var yourUrl = 'http://www.yoursite.com/yourpage';
scraperjs.StaticScraper.create(yourUrl)
 .scrape(function($) {
 return $("#my-select option").map(function() {
  return $(this).attr("value");
}).get();
})
.then(function(options) {
 console.log(options);
})

answered Nov 21, 2017 at 17:09

Paulo Ramos

1957 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to use jquery selector on nested html

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related