Parse JavaScript from html string in C#/Java

Question

I am trying to do some WebScraping of a site and the data is in dynamically loaded containers. It appears that the loading is done via JavaScript. Therefore I would need to execute it, in order to get it. I have written 2 versions of the program, one in Java and one in C#, so helping me with one would be nice enough.

I am currently using WebResponse/WebRequest in C# and HttpURLConnection in Java. I have to login into the site first, which already works like a charm. Now I need to parse the content, so the data gets filled in and the containers loaded. Is there an easy way to run the html through a browser control or an already included library?

Did you ignore all suggestions given when you wrote the question? stackoverflow.com/questions/720678/… — mplungjan
– mplungjan, Commented Nov 10, 2014 at 15:37
I have the HTML data of the website, where the javascript is not parsed yet. Normally the browser would do this job for me. But I do not know, how to do this in my program. I would either need a library which accepts a cookie for the session of the login or the html data to parse. — Kafioin
– Kafioin, Commented Nov 10, 2014 at 16:02

neofu · Accepted Answer · 2015-03-08 17:07:18Z

0

In C# you could just use a hidden WebControl. With that you could execute everything you need.

answered Mar 8, 2015 at 17:07

neofu

1087 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Parse JavaScript from html string in C#/Java

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related