Java parse data from html table with jsoup

Question

I want to get the data from the table from the link.

link:

https://www.nasdaq.com/symbol/aapl/financials?query=balance-sheet

I´ve tried my code but it doens´t work

public static void main(String[] args) {
    try {
        Document doc = Jsoup.connect("https://www.nasdaq.com/symbol/aapl/financials?query=balance-sheet").get();
        Elements trs = doc.select("td_genTable");



        for (Element tr : trs) {
            Elements tds = tr.getElementsByTag("td");
            Element td = tds.first();
            System.out.println(td.text());
        }
    } catch (IOException e) {
        e.printStackTrace();
    }
}

Can anybody help me? To get it to work

I´m not getting an output of the table. Nothing happens.

why it does not work? what is the problem?

elbraulio
– elbraulio

2019-01-09 17:51:02 +00:00
Commented Jan 9, 2019 at 17:51 — elbraulio
– elbraulio, Commented Jan 9, 2019 at 17:51

elbraulio · Accepted Answer · 2019-01-09 18:12:43Z

1

After test your code I've got and Read time out problem. Looking on Google I found this post where suggest to add an user agent to fix it and it worked for me. So, you can try this

public static void main(String[] args) {
    try {
        // add user agent
        Document doc = Jsoup.connect("https://www.nasdaq.com/symbol/aapl/financials?query=balance-sheet")
                .userAgent("Mozilla/5.0").get();
        Elements trs = doc.select("tr");
        for (Element tr : trs) {
            Elements tds = tr.select(".td_genTable");
            // avoid tr headers that produces NullPointerException
            if(tds.size() == 0) continue;
            // look for siblings (see the html structure of the web)
            Element td = tds.first().siblingElements().first();
            System.out.println(td.text());
        }
    } catch (IOException e) {
        e.printStackTrace();
    }
}

I have added User agent option and fix some query errors. This will be useful to start your work ;)

edited Jan 9, 2019 at 18:12

answered Jan 9, 2019 at 18:06

elbraulio

9946 silver badges15 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Marek Over a year ago

Thank you so much for helping me :)

Marek Over a year ago

But now it just prints out the firtst(left) column.

elbraulio Over a year ago

@Marek yes now the connection problem is fixed so you can analyze the html structure and set the proper queries on Jsoup to do your work. Try to do that, if you have problems you can create other new question with your attempt and I will help you.

Collectives™ on Stack Overflow

Java parse data from html table with jsoup

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related