Getting "invalid byte sequence for encoding "UTF8": 0x00" error when executing aws_s3.table_import_from_s3 command in postgresql

Question

I am getting below error when executing :

SELECT aws_s3.table_import_from_s3(   'test',  
'a,b,c,d,e',   
'(format csv)',  
'abc-ttt-dev',
   'outer/inner/Inbound/sample.csv',
   'us-east-1'
);

SQL Error [22021]: ERROR: invalid byte sequence for encoding "UTF8": 0x00 Where: COPY test, line 1 SQL statement "copy test (a,b,c,d,e) from '/rdsdbdata/extensions/aws_s3/amazon-s3-fifo-6826-20210708T140854Z-0' with (format csv)"

Just for information, Below query works perfectly fine.

SELECT aws_s3.table_import_from_s3(
   'test',
   'a,b,d,e',
   'DELIMITER ''|''', 
   'abc-ttt-dev',
   'outer/inner/Inbound/sample.txt',
   'us-east-1'
);

Table script is

CREATE TABLE test (
    a text not NULL,
    b text not NULL,
    c text not NULL,
    d text not NULL,
    e text not NULL
);

Naman · Accepted Answer · 2021-07-09 05:14:14Z

0

I think there are NULL values in your csv file and that is the reason you get this error.

You can either pre process the file using lambda or refer to Postgres error on insert - ERROR: invalid byte sequence for encoding “UTF8”: 0x00 for other workarounds.

answered Jul 9, 2021 at 5:14

Naman

3062 silver badges10 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Manish Nankar Over a year ago

There was some problem with my CSV file. I used another one and it worked well. Thanks for your help @Naman.

Collectives™ on Stack Overflow

Getting "invalid byte sequence for encoding "UTF8": 0x00" error when executing aws_s3.table_import_from_s3 command in postgresql

1 Answer 1

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related