How to simulate BatchWriteItem fail in DynamoDB?

Question

How can I create a controlled BatchWriteItem fail in DynamoDB?

Basically, I want to have a way of simulating failure (break BatchWriteItem on purpose) in DynamoDB so I can make sure the logic that takes UnprocessedItems in response is working correctly.

From documentation: http://docs.aws.amazon.com/amazondynamodb/latest/APIReference/API_BatchWriteItem.html

Typically, you would call BatchWriteItem in a loop. Each iteration would check for unprocessed items and submit a new BatchWriteItem request with those unprocessed items until all items have been processed.

Below are two similar solutions discussed that use do-while loop and callback:

JAVA with do-while:

http://docs.aws.amazon.com/amazondynamodb/latest/developerguide/batch-operation-document-api-java.html

NODE with callback:

How to handle UnprocessedItems using AWS JavaScript SDK (dynamoDB)?

How to prepare a "broken" BatchWriteItem request in order to test this?

Can DynamoDB end up in infinite loop? i.e. BatchWriteItem returns UnprocessedItems, the code takes UnprocessedItems and calls BatchWriteItem and returns UnprocessedItems again and again?

Bui Anh Tuan · Accepted Answer · 2017-10-13 07:58:26Z

4

You will get failed BatchWriteItem when due to throttling on the individual tables. So if you want to test in this case, you must make your DynamoDB tables become throttling. Steps:

Calculate Capacity write Unit of your DynamoDB table
Implement a function which writes too many into DynamoDB and make it reach maximum Capacity Write Unit.
Run your function BatchWriteItem. You will be able to get UnprocessedItems because your DynamoDb are throttling.

answered Oct 13, 2017 at 7:58

Bui Anh Tuan

9207 silver badges12 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Aaron_H Over a year ago

I tried this by setting the WCU on my table to 1. All I got instead was the response:

{"__type":"com.amazonaws.dynamodb.v20120810#ProvisionedThroughputExceededException","message":"The level of configured provisioned throughput for the table was exceeded. Consider increasing your provisioning level with the UpdateTable API."}

. When requests did go through, I still got {"UnprocessedItems": {} }.

Jorge Guerreiro Over a year ago

I also have the same issue, no UnprocessedItems, wonder if there is another way?

Collectives™ on Stack Overflow

How to simulate BatchWriteItem fail in DynamoDB?

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related