Java Html Parser that supports XPath Axes?

Question

Following is a fragment of an html document for which I need to associate the "title" - e.g. FILE_BYTES_WRITTEN - with the text() entry in the first succeeding .

The following xpath works great in python lxml:

/td[text()='FILE_BYTES_WRITTEN']/following-sibling::td

The doc fragment:

   <td>HDFS_BYTES_READ</td>
   <td align="right">4,825</td>
   <td align="right">0</td>
   <td align="right">4,825</td>
 </tr>

   <tr>

   <td>FILE_BYTES_WRITTEN</td>
   <td align="right">415,881</td>
   <td align="right">48,133</td>
   <td align="right">464,014</td>
 </tr>

   <tr>

   <td>HDFS_BYTES_WRITTEN</td>
   <td align="right">98,580,205</td>
   <td align="right">2,010</td>
   <td align="right">98,582,215</td>
 </tr>

But when I try to do this in Java I am having less success. I am not sure if there are any java html parsers that can support this. I am presently using HtmlCleaner.

Sage · Accepted Answer · 2013-10-22 19:23:36Z

1

You can look into HtmlUnit which has nice getByXPath() function. It is a guiless browser. Try to look into examples.

Another one that i use for parsing and like the most is Jsoup which has powerful select(query) function to do these things easily. Check out its selector class documentation. You will find everything you need.

answered Oct 22, 2013 at 19:23

Sage

15.5k3 gold badges36 silver badges40 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

WestCoastProjects · Accepted Answer · 2013-10-22 20:14:53Z

0

As a preamble: I will indeed look at HtmlUnit as suggested by @Sage.

In the meantime: I have come up with the following solution:

a) HtmlCleaner actually has a DomSerializer for converting to XHtml:

public static Document toXhtml(String html) throws ParserConfigurationException {
    HtmlCleaner cleaner = new HtmlCleaner();
    TagNode tagNode = cleaner.clean(html);
    DomSerializer domSerializer = new DomSerializer(new CleanerProperties());
    return domSerializer.createDOM(tagNode);
}

b) At the point that we have XHtml we have plenty of options- just use xalan for example..

answered Oct 22, 2013 at 20:14

WestCoastProjects

63.9k109 gold badges368 silver badges636 bronze badges

Collectives™ on Stack Overflow

Java Html Parser that supports XPath Axes?

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related