Cloud function attribute error: 'bytes' object has no attribute 'get' when reading json file from cloud storage

Question

I'm trying to read a JSON key file from Google Cloud Storage to authenticate. I have the following function:

storage_client = storage.Client()
bucket_name = 'bucket_name'
bucket = storage_client.get_bucket(bucket_name)
blob = bucket.get_blob('key.json')
json_data_string = blob.download_as_string()

credentials = ServiceAccountCredentials.from_json_keyfile_dict(
    json_data_string,
    scopes=['https://www.googleapis.com/auth/analytics',
            'https://www.googleapis.com/auth/analytics.edit'])

and the following error: AttributeError: 'bytes' object has no attribute 'get'

How should I read/format my key.json file to use it with ServiceAccountCredentials

Dustin Ingram · Accepted Answer · 2020-02-10 19:08:56Z

2

The download_as_string() function returns bytes, but from_json_keyfile_dict() expects a dict. You need to first decode the bytes to turn it into a string:

json_data_string = blob.download_as_string().decode('utf8')

And then load this string as a dict:

import json
json_data_dict = json.loads(json_data_string)

And then you can call:

credentials = ServiceAccountCredentials.from_json_keyfile_dict(
    json_data_dict,
    scopes=['https://www.googleapis.com/auth/analytics',
            'https://www.googleapis.com/auth/analytics.edit'])

answered Feb 10, 2020 at 19:08

Dustin Ingram

21.8k7 gold badges69 silver badges86 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Simon Breton Over a year ago

What are bytes exactly? Is there a way to directly access json file from storage in the proper format?

Dustin Ingram Over a year ago

See stackoverflow.com/questions/10060411/…. The "proper format" is subjective here, Cloud Storage just stores binary blobs, so it's up to you to turn it into the format you're expecting it to be.

Simon Breton Over a year ago

Ok. so whatever I extract from Cloud Storage it will always be binary blobs.

Collectives™ on Stack Overflow

Cloud function attribute error: 'bytes' object has no attribute 'get' when reading json file from cloud storage

1 Answer 1

3 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related