Android: Extracting html source

Well if I understood correctly (let me know if I did not):

If it user/password protected should you issue a Http Post (that is what you do from a browser for example) and get the Response from that post? Something like this :

http://www.informit.com/guides/content.aspx?g=java&seqNum=44

EDIT: Here is a sample

I have a page that looks like this (it is oversimplified, but nevertheless here it is):

<form action="../../j_spring_security_check" method="post" >
        <input id="j_username" name="j_username" type="text" />
            <input id="j_password" name="j_password" type="password"/>
                    <input type="image" class="submit" id="login" name="login" />
</form>

If it where is a web page, you would have to provide the username/password to get the actual content "after" this login page. What you really issue is a HTTP POST here (I bet it's the same in your case).

Now to get the same functionality in a programmatic way...

You will need the apache http client library (you could probably do without it, but this is the easy way). Here is the maven dependency for it. you are going this for Android, right? apache http client is the default in Android from what I've read.

<dependency>
<groupId>commons-httpclient</groupId>
<artifactId>commons-httpclient</artifactId>
<version>3.1</version>

import org.apache.commons.httpclient.Header;
import org.apache.commons.httpclient.HttpClient;
import org.apache.commons.httpclient.methods.GetMethod;
import org.apache.commons.httpclient.methods.PostMethod;

public class HttpPost {
    public static void main(String[] args) {

        HttpClient httpClient = new HttpClient();
        PostMethod postMethod = new PostMethod("http://localhost:20000/moika/moika/j_spring_security_check");
        postMethod.addParameter("j_username", "ACTUAL_USER");
        postMethod.addParameter("j_password", "ACTUAL_PASSWORD");

        try {
            int status = httpClient.executeMethod(postMethod);
            System.out.println("STATUS-->" + status);

            if(status == 302){
                Header header = postMethod.getResponseHeader("location");
                String location = header.getValue();
                System.out.println("HEADER_VALUE-->" + location);
                GetMethod getMethod = new GetMethod(location);
                httpClient.executeMethod(getMethod);
                String content = getMethod.getResponseBodyAsString();
                System.out.println("CONTENT-->" + content);
            }

            String contentInCaseOfNoRedirect = postMethod.getResponseBodyAsString();

        } catch (Exception exception){
            exception.printStackTrace();
        }
    }
}

This might look weird a bit, but I perform a redirect (302), there seems to be an issue with that in RCF, thus the small work-around.

If you do not perform any re-directs on the server side, then you could ignore the part where I check for 302.

See what works for you.

Cheers, Eugene.

see the http://docs.oracle.com/javase/tutorial/networking/urls/readingWriting.html

or check the sample code

How to read content of URL

try{
        URL oracle = new URL("http://www.w3schools.com/html/html_tables.asp");
        URLConnection yc = oracle.openConnection();
        InputStream is = yc.getInputStream();
        String inputLine;
        BufferedReader in = new BufferedReader(
                new InputStreamReader(
                yc.getInputStream()));
        while ((inputLine = in.readLine()) != null) 
            System.out.println(inputLine);
        in.close();

        }catch(Exception ex){
            ex.printStackTrace();
        }