Errors when inserting records into BigQuery with Python

Question

I'm running into an issue when i'm inserting rows into bigquery

The error is simply 'backend error' and nothing else

I'm taking 10k rows at a time, and doing an insert, after about 40k records are inserted I get 'backend error'

I'm using python and inserting with this code

from google.cloud import bigquery
_bigquery_client = bigquery.Client()
rows=[[1,2],[3,4]]
_bigquery_client.insert_rows(rows)

Ricco D · Accepted Answer · 2021-09-17 03:33:49Z

1

The backend error is due to temporary server failure such as a network connection problem or a server overload.

backendError | 500 or 503

This error returns when there is a temporary server failure such as a network connection problem or a server overload.

These errors are being encountered from time to time but with a very low ratio which should comply to the BigQuery SLA. The fix for this is to just retry the insert.

answered Sep 17, 2021 at 3:33

Ricco D

7,3451 gold badge10 silver badges19 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Errors when inserting records into BigQuery with Python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related