loading multiple csv files in single postgres table

Question

my postgres version is 12.4 , I'm loading multiple csv files into single table, The problem here is every time firing below command is not good ,any other alternative (or) suggestions are there?

COPY testemail FROM '/md-data/vamshi/s3data/test_Hash_2021.csv' WITH (FORMAT csv);
COPY testmail FROM '/md-data/vamshi/s3data/test_Hash_2025.csv' WITH (FORMAT csv);
COPY testmail FROM '/md-data/vamshi/s3data/test_Hash_2026.csv' WITH (FORMAT csv);
 ..............etc

and below command also i tried, but its not working,

 COPY testemail FROM '/md-data/vamshi/s3data/t*.csv' WITH (FORMAT csv);

Why do you think the first one is "not good"? copy doesn't support wildcards. If you want to automate this, write a shell script that iterates over the files and runs COPY for each of them. Or write a shell script that copies all files into one large file, then run the COPY once — user330315
– user330315, Commented Apr 7, 2021 at 6:51

Aymanadou · Accepted Answer · 2021-04-07 10:39:22Z

1

you can load all files using:

 cat /md-data/vamshi/s3data/test_Hash*.csv | psql -c 'COPY testemail from stdin CSV HEADER'

answered Apr 7, 2021 at 10:39

Aymanadou

1,2202 gold badges15 silver badges37 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

loading multiple csv files in single postgres table

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related