downloading multiple files from URLs using powershell

Question

I have a text file which consists of 100s of URLs. Those URLs again contain different installer files(.exe, .msi, .bat, .txt etc..)

I need to download those files onto my local machine using Invoke-WebRequest. But how can I download files without specifying the extension type of it in the Output path?

File.txt:

https://foo.com/path/to/file.exe?token=ahcdj009a
https://foo.com/path/to/file.msi?token=ansjndhkg
https://foo.com/path/to/file.lpr?token=553dndgbs
https://foo.com/path/to/file.txt?token=amnewa453
...etc

How do I download all the files from the URLs onto a Windows local machine using Invoke-WebRequest PowerShell command?

Possible duplicate of PowerShell Invoke-WebRequest, how to automatically use original file name? and stackoverflow.com/questions/23398479/… and stackoverflow.com/questions/38599653/… — TessellatingHeckler
– TessellatingHeckler, Commented Aug 31, 2016 at 19:27

Amir Saar · Accepted Answer · 2016-08-31 20:24:35Z

0

If the pattern stays this way (. + file extension + ?), you can use these two lines, while $fileExt is the file extension. Hope it helps a bit :)

$d -match "\.(\w+)\?"
$fileExt = $matches[1]

answered Aug 31, 2016 at 20:24

Amir Saar

907 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Michael · Accepted Answer · 2017-08-24 01:22:35Z

0

You wont want to use just iwr. You will need to use something in addition to that to download the files. Start-BitsTranfer should work.

If you want to download all linked images for example, you can try this:

$URL = "http://www.website.com"

$Site = iwr -Uri $URL

$Images = ($Site).Images.src

foreach ($Image in $Images) {

Start-BitsTransfer -Source $Image -Destination C:\Test\ -TransferType Download

}

answered Aug 24, 2017 at 1:22

Michael

391 bronze badge

Collectives™ on Stack Overflow

downloading multiple files from URLs using powershell

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related