Fetch source code of web page using java?

Question

I have a URL like this and the following method

public static void saveContent( String webURL )throws Exception 
{

    URL website = new URL(webURL);
    URLConnection connection = website.openConnection();
    BufferedReader in = new BufferedReader(
                            new InputStreamReader(
                                connection.getInputStream()));

    StringBuilder response = new StringBuilder();
    String inputLine;

    while ((inputLine = in.readLine()) != null) 
        response.append(inputLine);

    in.close();

    System.out.println(response.toString());
}

However, When I want to print web content, it always fetches the source code of the main page(www.google.com).

How can I solve my problem ? Thanks for your help.

I think you should check your webURL parameter. May be when you call saveContent method passing value of webURL. The value of webURL already set "www.google.com". — Gautam
– Gautam, Commented Oct 13, 2014 at 17:47
As a general suggestion, I'd recommend that you take a look at Jsoup. — The Head Rush
– The Head Rush, Commented Oct 13, 2014 at 17:48

m0tylan0ga · Accepted Answer · 2014-10-13 17:49:29Z

1

I copied yours code to netbeans and it seems to work correctly. I think the problem could lead on content in method argument "webURL". Try run your app on debug mode and look what you've got back there.

answered Oct 13, 2014 at 17:49

m0tylan0ga

946 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

m0tylan0ga Over a year ago

It has to be something with this URL because on my environment it works correctly... I sent to this method statically main page from facebook and I've got a proper result...

Collectives™ on Stack Overflow

Fetch source code of web page using java?

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related