Get the result of javascript function while scraping web page content

Question

Is it possible to extract the value of a variable used in java script in a web page. I need to get the url stored in javascript function in a web page. In web page the function is called using <a href,

when we click on that hyperlink , java script function is called and the url is returned.
Below is the code,

<a class="dld" OnClick="download_file();" href="javascript:"> </a>

The script function is

function download_file() {
    var summaryFlag     = 0;
        if(document.getElementById("frmincludefile").checked){
    summaryFlag=1; }
    url = '/filedatabase/file_process_request.html?mru=53616c7465645f5f3f24b8f4a86301eb202e67fbb679df4356e24fee9d7a17a099010eb5acf5985c&type=doc';
    url += '&sum='+summaryFlag+'&logo=0&xcode=xtritiuminx&serve_txt=0&folderid=';
    document.location   = url;
}

How can i get value of url variable.

No, I'm extracting the content from a web page. I need to know how to extract the value of variable used in javascript. — Maddy
– Maddy, Commented Jul 24, 2012 at 6:47

Maddy · Accepted Answer · 2012-07-25 12:11:44Z

1

I was not able to the result of java script function but now i'm invoking the javascript using webBrowser1.Document.InvokeScript("download_file"); By invoking the java script i'm able to download the file.

answered Jul 25, 2012 at 12:11

Maddy

2631 gold badge9 silver badges24 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Vishal Suthar · Accepted Answer · 2012-07-24 06:52:10Z

0

Set the URL var value in any hidden field

for e.g.

document.getElementById("hidden_field_name").value = url;

edited Jul 24, 2012 at 6:52

Vishal Suthar

17.2k4 gold badges64 silver badges109 bronze badges

answered Jul 24, 2012 at 6:48

sandip patil

6584 silver badges8 bronze badges

1 Comment

Maddy Over a year ago

I can't edit the function , since i'm extracting data from a web page. The url contains the path to download a file, how to extract that variable content.

Minko Gechev · Accepted Answer · 2012-07-24 07:37:54Z

0

You can do this using variable in the upper scope. In the example bellow I'm using global variable (bad practice) to save the localUrl value from the redirect function:

var url = '';

function redirect() {
  var googleRadio = document.getElementById('google');
  if (googleRadio.checked) {
    localUrl = 'http://google.com';
    url = localUrl;
  }
}

edited Jul 24, 2012 at 7:37

answered Jul 24, 2012 at 7:30

Minko Gechev

25.8k9 gold badges64 silver badges69 bronze badges

2 Comments

Maddy Over a year ago

Thank you for your reply, Minko Gechev. But i'm scraping the page, i can't write any functions in the page. How to get the value once the page load is completed.

Minko Gechev Over a year ago

If you are calling the download_file on mouse click you can get the value only on user interaction. You also can simulate it with firing the event (trigger of jQuery) but I don't think that the code will be very "beautiful" and readable in that case.

Collectives™ on Stack Overflow

Get the result of javascript function while scraping web page content

3 Answers 3

Comments

1 Comment

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

1 Comment

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related