Migrating Data From Amazon Redshift into DynamoDB

Question

There are tons of examples to migrate data from DynamoDB to Redshift, but I couldn't find any example or documentation for migrating data from Redshift to DynamoDB. Any suggestion/example/doc for migrating data from Redshift into DynamoDB in an efficient way?

gkatzioura · Accepted Answer · 2017-02-10 11:53:46Z

4

One solution which includes writing some code is to use RedShift's unload feature and put the query data into an s3 bucket. By doing so you can handle the Put Event for this specific bucket and either trigger a lambda function that persists data to dynamodb, or send an sqs message to a beanstalk worker which does the same action (persisting data to dynamodb)

answered Feb 10, 2017 at 11:53

gkatzioura

2,8502 gold badges30 silver badges47 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Barath Ravichander · Accepted Answer · 2022-10-17 05:53:22Z

0

There are multiple ways you can migrate from Redshift to DynamoDB

You can unload the data from redshift using "UNLOAD" and save the files to s3. From s3 you can use multiple services to migrate the data.

You can use aws pipeline to read data from s3 and load into dynamo
You can use AWS Glue to read data into its dataframe and load into dynamo -> an approach i prefer
You can use s3 import

But you unload from redshift as a redshift json you need to convert into dynamo Json and then load into the DB

answered Oct 17, 2022 at 5:53

Barath Ravichander

1691 silver badge8 bronze badges

Collectives™ on Stack Overflow

Migrating Data From Amazon Redshift into DynamoDB

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related