Skip columns while copying data into redshift from S3 using copy command

Question

I have a CSV table in S3 with 100's of attributes/features, I don't want to create table in RedShift with all these attributes before importing data. Is there anyway to select only the columns I need while copying data from S3 into Redshift?

Possible duplicate of in redshift postgresql can I skip columns with the copy function — Bruno Reis
– Bruno Reis, Commented Jun 8, 2016 at 20:19

Community · Accepted Answer · 2017-05-23 11:52:32Z

0

You cannot achieve the above using just a copy command it is doable using a python script. Please go through this

Read specific columns from a csv file with csv module?

edited May 23, 2017 at 11:52

CommunityBot

11 silver badge

answered Jun 8, 2016 at 20:20

Piyush Patil

14.6k8 gold badges45 silver badges59 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Sailendra Pinupolu · Accepted Answer · 2016-06-08 21:16:06Z

0

There are couple of options listed in aws forum for this problem, take a look at https://forums.aws.amazon.com/message.jspa?messageID=432590 if they may work for you.

answered Jun 8, 2016 at 21:16

Sailendra Pinupolu

1,1381 gold badge10 silver badges8 bronze badges

Collectives™ on Stack Overflow

Skip columns while copying data into redshift from S3 using copy command

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related