How to write data in Azure Blob storage programmatically?

Question

I am using below PowerShell script to read JSON data using REST API call from source. Now I want to load the data of $Result to the Azure Blob Storage. Any idea please?

$Params = @{
 "URI" = 'https://3ea5e53b-817e-4c41-ae0b-c5afc1610f4e-bluemix.cloudant.com/test/_all_docs?include_docs=true'
}
 
$Result = Invoke-RestMethod @Params | ConvertTo-Json -Depth 9

check out the az.storage module. learn.microsoft.com/en-us/powershell/module/az.storage/… — Bee_Riii
– Bee_Riii, Commented Feb 17, 2021 at 7:57

Jim Xu · Accepted Answer · 2021-02-17 07:59:56Z

4

Regarding the issue, you can use the following ways

Save the JSON into one file then upload the file to Azure blob

$Params = @{
 "URI" = 'https://3ea5e53b-817e-4c41-ae0b-c5afc1610f4e-bluemix.cloudant.com/test/_all_docs?include_docs=true'
}
 
$Result = Invoke-RestMethod @Params | ConvertTo-Json -Depth 9
$Result | Out-File "D:\file.json"

$context=New-AzStorageContext -StorageAccountName "andyprivate" -StorageAccountKey ""

Set-AzStorageBlobContent -File "D:\file.json" `
  -Container "" `
  -Blob "file.json" `
  -Context $context `
  -StandardBlobTier Hot

Directly upload to Azure blob

$Params = @{
 "URI" = 'https://3ea5e53b-817e-4c41-ae0b-c5afc1610f4e-bluemix.cloudant.com/test/_all_docs?include_docs=true'
}
 
$Result = Invoke-RestMethod @Params | ConvertTo-Json -Depth 9
Write-Host "the result is :"
$Result 

$context=New-AzStorageContext -StorageAccountName "andyprivate" -StorageAccountKey ""

$container=Get-AzStorageContainer -Name "input" -Context $context

$content = [system.Text.Encoding]::UTF8.GetBytes($Result)

$container.CloudBlobContainer.GetBlockBlobReference("my.json").UploadFromByteArray($content,0,$content.Length)

answered Feb 17, 2021 at 7:59

Jim Xu

23.2k2 gold badges24 silver badges41 bronze badges

Sign up to request clarification or add additional context in comments.

7 Comments

Dinesh Madhup Over a year ago

Thanks Jim. Same way can we load data to Azure Cosmos DB (Mongo API)? For example: directly upload to Azure Cosmos DB

Jim Xu Over a year ago

@DineshMadhup If you have a new issue, I suggest you create a new issue in StackOverflow. Then you can tell me, I will help you.

Dinesh Madhup Over a year ago

Thank you! I have created new thread, please see here stackoverflow.com/questions/66255263/…

Dinesh Madhup Over a year ago

Jim, is it possible to exclude "total_rows: 1, "offset": 0, and "rows". Because my source data doesn't contain that. I don't know from where these value get appended.

Jim Xu Over a year ago

@DineshMadhup please try to the script $Result = Invoke-RestMethod @Params ($Result.PSObject.Properties.Item('rows')).value | ConvertTo-Json

|

Collectives™ on Stack Overflow

How to write data in Azure Blob storage programmatically?

1 Answer 1

7 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

7 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related