Reading Response From URL using HTTP WEB REQUEST

Question

I have to read response from http://www.subway.com/storelocator/default.aspx?zip=04416&country=USA .I have used following code but does not get all the response. instead of it gives response of error page Thanks in advance.

protected void Page_Load(object sender, EventArgs e)
{

    string sUrl = "http://www.subway.com/storelocator/default.aspx?zip=04416&country=USA";
    XmlDocument rssDoc = new XmlDocument();
    XmlTextReader rssReader = new XmlTextReader(sUrl.ToString());

    WebRequest wrGETURL;
    wrGETURL = WebRequest.Create(sUrl);

    Stream objStream;
    objStream = wrGETURL.GetResponse().GetResponseStream();
    StreamReader objReader = new StreamReader(objStream, Encoding.UTF8);
    WebResponse wr = wrGETURL.GetResponse();
    Stream receiveStream = wr.GetResponseStream();
    StreamReader reader = new StreamReader(receiveStream, Encoding.UTF8);
    string content = reader.ReadToEnd();
    Response.Write(content);
   }

AFAIK you have to call wrGETURL.GetResponse() before using anything within the response — Mario The Spoon
– Mario The Spoon, Commented Jul 20, 2012 at 6:40

L.B · Accepted Answer · 2012-07-20 07:32:30Z

11

I don't know what you want to do with XmlTextReader since returned content is html not xml, however setting UserAgent is enough to get the page.

HttpWebRequest req = (HttpWebRequest)HttpWebRequest.Create("http://www.subway.com/storelocator/default.aspx?zip=04416&country=USA");
req.UserAgent = "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; .NET4.0C; .NET4.0E)";
using (var resp = req.GetResponse())
{
    var html = new StreamReader(resp.GetResponseStream()).ReadToEnd();
}

edited Jul 20, 2012 at 7:32

answered Jul 20, 2012 at 7:25

L.B

116k20 gold badges189 silver badges229 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Janhavi Over a year ago

Yes it is working now but if i need to get response for subway.com/storelocator/default.aspx?zip=04416&country=USA this url it not gives all store what i do to get all store from subway if we specify miles distance

L.B Over a year ago

@Janhavi Your question was I have to read response from .. and you got it. You should know why your url doesn't give the data you expect.

Martijn Pieters · Accepted Answer · 2021-05-07 00:38:54Z

3

Stream objStream;
StreamReader objSR;
System.Text.Encoding encode = System.Text.Encoding.GetEncoding("utf-8");

string str = "http://domaninname.com/YourPage.aspx?name=" + "abc";
HttpWebRequest wrquest = (HttpWebRequest)WebRequest.Create(str);
HttpWebResponse getresponse = null;
getresponse = (HttpWebResponse)wrquest.GetResponse();

objStream = getresponse.GetResponseStream();
objSR = new StreamReader(objStream, encode, true);
string strResponse = objSR.ReadToEnd();
Response.Write(strResponse);

edited May 7, 2021 at 0:38

Martijn Pieters

1.1m326 gold badges4.2k silver badges3.4k bronze badges

answered Jul 20, 2012 at 6:33

Satinder singh

10.2k18 gold badges64 silver badges102 bronze badges

Comments

Marselz · Accepted Answer · 2021-01-13 10:23:00Z

0

In just one line, with easier vb.net (that gets same performance as c#)

Return New System.IO.StreamReader(System.Net.HttpWebRequest.Create("http://urltogetthecontents.com").GetResponse().GetResponseStream()).ReadToEnd()

answered Jan 13, 2021 at 10:23

Marselz

1

Collectives™ on Stack Overflow

Reading Response From URL using HTTP WEB REQUEST

3 Answers 3

2 Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

2 Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related