Powershell - assign source code of ASP page to a variable

Question

probably it is a silly question, but I couldn't find the answer in Google so far. I need to read the HTML source code of a page http://Mysite/ViewRequest.aspx?request_id=xxx. I've setup following

wc = new-object -com internetexplorer.application
$wc.visible = $false
$wc.navigate2($strGRSpage).Document
$wc.silent = $true
$wc.visible = $false
$GRSstr = $wc.Document.body.IHTMLElement_outerText

Unfortunately the IE page pops up, even if I set $wc.silent = $true and $wc.visible = $false. Is there another way (even with HTTP request GET) to retrieve that data without getting the IE page. NOTE. The site http://Mysite/ViewRequest.aspx?request_id=xxx supports just IE and Mozilla. When I tried to use Webclient Class I get always unsupported browser.

In VBscript following works (but I want it in Powershell)

Set oHTML = CreateObject("Microsoft.XMLHTTP")  
Set oWeb = CreateObject("InternetExplorer.Application")  
oHTML.open "GET" , strGRSpage, false 
oHTML.send  
strGRStext = oHTML.responseText

Many thanks,

Marco

manojlds · Accepted Answer · 2011-09-27 18:19:42Z

1

You just have to add an appropriate user-agent header.

For example:

$wc = new-object system.net.webclient
$wc.Headers.Add("user-agent", "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; .NET CLR 1.0.3705;)")
$wc.DownloadFile("http://whatsmyuseragent.com/","d:\index.html")

answered Sep 27, 2011 at 18:19

manojlds

303k66 gold badges482 silver badges426 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

user967598 Over a year ago

I already tried to specify the User agent, but I get the same error. Is there a way to simulate IE User agent?

icnivad · Accepted Answer · 2011-09-27 18:18:30Z

1

When trying the webclient Class maybe You're just missing to add a "valid" user Agent

$wc.Headers.Add("user-agent", "Valid WebClient Header")

answered Sep 27, 2011 at 18:18

icnivad

2,2919 gold badges30 silver badges35 bronze badges

Comments

user967598 · Accepted Answer · 2011-09-28 08:49:15Z

0

After Googling a little bit I found out how to setup my user agent to get the compatibility with IE.

Final code is 
$wc = new-object system.net.webclient
$wc.Headers.Add("user-agent", "Windows-RSS-Platform/2.0 (MSIE 9.0; Windows NT 6.1)")
$GRSstr = $wc.DownloadString($strGRSpage)

Many thanks for your help.

Regards, Marco

----- Please mark as answer ------

answered Sep 28, 2011 at 8:49

user967598

552 silver badges8 bronze badges

Collectives™ on Stack Overflow

Powershell - assign source code of ASP page to a variable

3 Answers 3

1 Comment

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

1 Comment

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related