Exporting table from Amazon RDS into a csv file using Golang API

Question

I am looking for some way to directly export the SQL query results to a CSV file from AWS lambda. I have found this similar question - Exporting table from Amazon RDS into a csv file. But it will not work with the AWS Golang API.

Actually, I want to schedule a lambda function which will daily query some of the views/tables from RDS(SQL Server) and put it to the S3 bucket in CSV format. So, I want to directly download the query results in the CSV form in the lambda and then upload it to S3.

I have also found data pipeline service of AWS to copy RDS data to S3 directly, but I am not sure if I can make use of it here.

It would be helpful if anyone can suggest me the right process to do it and references to implement it.

Are you lloking for this query results to a CSV file in the local machine or I want to schedule a lambda function (I assume you refer to AWS lambda). Running code in cloud and in local machine are two different things. — Dmitry Harnitski
– Dmitry Harnitski, Commented Jan 5, 2020 at 15:34
@DmitryHarnitski Sorry for the confusion. I want to schedule a lambda function. — Rahul Satal
– Rahul Satal, Commented Jan 5, 2020 at 15:59

AWS PS · Accepted Answer · 2020-01-05 16:04:31Z

1

You can transfer files between a DB instance running Amazon RDS for SQL Server and an Amazon S3 bucket. By doing this, you can use Amazon S3 with SQL Server features such as BULK INSERT. For example, you can download .csv, .xml, .txt, and other files from Amazon S3 to the DB instance host and import the data from D:\S3\into the database. All files are stored in D:\S3\ on the DB instance

Reeference:

https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/User.SQLServer.Options.S3-integration.html

edited Jan 5, 2020 at 16:04

answered Jan 5, 2020 at 15:56

AWS PS

4,7731 gold badge11 silver badges24 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Rahul Satal Over a year ago

Thanks for the response. But I want to query data from RDS(SQL Server) and not Aurora.

Rahul Satal Over a year ago

Following the documentation, I have created the IAM role and set up it into the RDS instance. But even after spending so much time, I couldn't create a stored procedure to export the result in CSV. I am getting this error - stackoverflow.com/questions/59602890/…

Collectives™ on Stack Overflow

Exporting table from Amazon RDS into a csv file using Golang API

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related