How to download an Azure Blob Storage file via URL in Python?

Question

I am trying to download an Azure Blob Storage file from my storage account, to do so, I have checked what the URL is and I am doing the following:

with urllib.request.urlopen("<url_file>") as resp:
    img = np.asarray(bytearray(resp.read()), dtype="uint8")

But I am getting the following error:

urllib.error.HTTPError: HTTP Error 404: The specified resource does not exist.

I have doubled checked that the url is correct. Could this have something to do with not having passed the keys of my subscription or any other info about the Storage Account?

Any idea?

Hemachandra Ghanta · Accepted Answer · 2019-12-26 22:24:23Z

9

As on Dec 26, 2019 I am unable to import BaseBlobService from azure cloud storage. Neither of BlobPermissions, generate_blob_shared_access_signature worked for me. Below is something I used and it worked in my case and hope it helps

from azure.storage.blob import generate_blob_sas, AccountSasPermissions

def scan_product():

    account_name=<account_name>
    container_name=<container_name>
    blob_name=<blob_name>
    account_key=<account_key>
    url = f"https://{account_name}.blob.core.windows.net/{container_name}/{blob_name}"
    sas_token = generate_blob_sas(
        account_name=account_name,
        account_key=account_key,
        container_name=container_name,
        blob_name=blob_name,
        permission=AccountSasPermissions(read=True),
        expiry=datetime.utcnow() + timedelta(hours=1)
    )

    url_with_sas = f"{url}?{sas_token}"

edited Dec 26, 2019 at 22:24

answered Dec 26, 2019 at 22:19

Hemachandra Ghanta

3023 silver badges12 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Siddharth Pant Over a year ago

You sir are a godsend! (btw if you are on jupyter notebook and trying to print the url_with_sas, it will URL encode it so beware of that). I got the URL thingy but then was stuck for an hour on that jupyter URL encode behaviour.

S Andrew Over a year ago

Bhai dil jeet liya

Himanshu Over a year ago

giving status code 401? Any idea what to do? Used the same above code.

qwr Feb 20 at 19:54

I think this may fail if the blob name has special characters like space, which the URL will % encode.

Peter Pan · Accepted Answer · 2019-06-26 10:18:23Z

Actually, you can generate a blob url with sas token in Azure Storage SDK for Python for accessing directly, as my sample code below.

from azure.storage.blob.baseblobservice import BaseBlobService
from azure.storage.blob import BlobPermissions
from datetime import datetime, timedelta

account_name = '<account name>'
account_key = '<account key>'
container_name = '<container name>'
blob_name = '<blob name>'

url = f"https://{account_name}.blob.core.windows.net/{container_name}/{blob_name}"

service = BaseBlobService(account_name=account_name, account_key=account_key)
token = service.generate_blob_shared_access_signature(container_name, blob_name, permission=BlobPermissions.READ, expiry=datetime.utcnow() + timedelta(hours=1),)

url_with_sas = f"{url}?{token}"

Then,

import urllib
import numpy as np

req = urllib.urlopen(url_with_sas)
img = np.asarray(bytearray(req.read()), dtype=np.uint8)

Ivan Glasenberg · Accepted Answer · 2019-06-26 10:02:34Z

2

For downloading using url directly, you should put the blob in a public container, or in the private container then you should generate a sas token for the blob(the url looks like : https://xxx.blob.core.windows.net/aa1/0116.txt?sp=r&st=2019-06-26T09:47:04Z&se=2019-06-26xxxxx).

I test your code with the url which contains a sas token, it can be downloaded.

Test result:

How to generate sas token for a blob:

edited Jun 26, 2019 at 10:02

answered Jun 26, 2019 at 9:50

Ivan Glasenberg

30.3k2 gold badges56 silver badges68 bronze badges

Comments

Marisa · Accepted Answer · 2019-06-26 10:06:04Z

1

To solve the issue all I needed to do was to change the Blob Storage access level to Blob (anonymous read access for blob only). Once this is done, it will work.

answered Jun 26, 2019 at 10:06

Marisa

1,2034 gold badges22 silver badges34 bronze badges

1 Comment

Ivan Glasenberg Over a year ago

Hi, I also mentioned that make the container public in my answer. You should consider my post. Thanks.

Collectives™ on Stack Overflow

How to download an Azure Blob Storage file via URL in Python?

4 Answers 4

4 Comments

Comments

Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

4 Comments

Comments

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related