How to authenticate http request, for accessing gcp API services (python)

Question

In order to get the enabled GCP-api services list, I am trying to get the service.list as per this HTTP request in this link.

Here's my code:

import json
from requests.auth import HTTPBasicAuth
import requests
from google.oauth2 import service_account


auth = HTTPBasicAuth('[email protected]','xyz....')

url = 'https://serviceusage.googleapis.com/v1/projects/my-proj-id123/services'

headers = {
   "Accept": "application/json"
 }

response = requests.request(
   "GET",
   url,
   headers=headers,
   auth=auth
 )
# a=json.loads(response.text)
print(response.text)

But I am getting this error:

{
  "error": {
    "code": 403,
    "message": "The request is missing a valid API key.",
    "status": "PERMISSION_DENIED"
  }
}

NOTE: I need a way to get the respond as per this link, either by service account or by api token . I have service account key (credential.json) but I don't know where to put for http request. kindly suggest me the procedures.

Instructions on how to set up authorization are located here. credentials.json should be located in your home directory. — MattDMo
– MattDMo, Commented Dec 27, 2021 at 16:22
Google Cloud does not support HTTP Basic Authorization. For most APIs, you must use a Bearer token. Authorization: Bearer TOKEN. — John Hanley
– John Hanley, Commented Dec 27, 2021 at 18:56

DazWilkin · Accepted Answer · 2021-12-28 17:32:12Z

2

I encourage you to consider using Google's SDKs whenever you interact with Google's services.

Not only do the services provide language-specific resource types that facilitate creating requests and responses, but you get simpler auth, logging etc. etc. etc.

Documented:

google_auth
Python Client for Service Management API
list_services --> ListServicesPager --> ListServicesResponse --> ManagedService
APIs Explorer --> Service Management --> services.list --> Response --> ManagedService

Setup:

PROJECT=[[YOUR-PROJECT]]
ACCOUNT=[[YOUR-ACCOUNT]]

python3 -m venv venv
source venv/bin/activate

python3 -m pip install google-auth
python3 -m pip install google-cloud-service-management

gcloud iam service-accounts create ${ACCOUNT} \
--project=${PROJECT}

EMAIL="${ACCOUNT}@${PROJECT}.iam.gserviceaccount.com"

gcloud projects add-iam-policy-binding ${PROJECT} \
--member=serviceAccount:${EMAIL} \
--role=roles/viewer

gcloud iam service-accounts keys create ${PWD}/${ACCOUNT}.json \
--iam-account=${EMAIL}

export GOOGLE_APPLICATION_CREDENTIALS=${PWD}/${ACCOUNT}.json

python3 ./main.py

main.py:

import google.auth
from google.cloud import servicemanagement_v1

credentials,project = google.auth.default()

client = servicemanagement_v1.ServiceManagerClient()

# How to construct the Request
rqst = {
     # Purely for example
    "pageSize": 5,
     # List only project's services
    "consumer_id: "project:{project}".format(
        project=project
    )
}

# Response is a ServiceListPager
resp = client.list_services(request=rqst)

# Which is iterable
for managed_service in resp:
    try:
        # This is a quirk of gRPC Transcoding
        # Convert a ManagedService to JSON
        j=servicemanagement_v1.ManagedService.to_json(managed_service)
        print(j)
    except Exception as e:
        print(e)

Yields:

{
  "serviceName": "abusiveexperiencereport.googleapis.com",
  "producerProjectId": ""
}
{
  "serviceName": "acceleratedmobilepageurl.googleapis.com",
  "producerProjectId": ""
}
{
  "serviceName": "accessapproval.googleapis.com",
  "producerProjectId": ""
}
...

edited Dec 28, 2021 at 17:32

answered Dec 27, 2021 at 18:33

DazWilkin

41.7k8 gold badges61 silver badges113 bronze badges

Sign up to request clarification or add additional context in comments.

8 Comments

sudhar chrome Over a year ago

here how can i filter the disabled service by using my gcp project id

DazWilkin Over a year ago

Please read the documentation. You can include the consumerId set to the Project ID in the request.

sudhar chrome Over a year ago

i have tried by mentioning "consumerId" rqst = { # "pageSize": 5 # Purely for example "consumerId" : "my-proj-id-123" } but i am getting error

pb_type = self._meta.fields[key].pb_type KeyError: 'consumerId'  During handling of the above exception, another exception occurred:  "Unknown field for {}: {}".format(self.__class__.__name__, key) ValueError: Unknown field for ListServicesRequest: consumerId

DazWilkin Over a year ago

I'll try it for you later this morning when I get to my computer

DazWilkin Over a year ago

You're welcome. Glad it's working and pleased that you were willing to try the SDK.

|

Collectives™ on Stack Overflow

How to authenticate http request, for accessing gcp API services (python)

1 Answer 1

8 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

8 Comments

Your Answer

Sign up or log in

Post as a guest

Related