Data ends up with incorrect encoding when reading SQL from a .sql file instead of executing it in SQLite Browser

Question

I got this SQL statement that I wish to run on SQLite:

INSERT INTO tEntity (name) VALUES ('Roger Café');

Note the é character. Using the SQLite browser, I can insert this statement with the proper encoding.

However, if I save the above statement as a file (my.sql) and then run it on the Windows command line, I am having an encoding problem. The é in Café is garbled up.

C:\somewhere> sqlite3.exe my.db
sqlite> .read my.sql

I'm using Notepad++ to create the file in ANSI encoding. I have tried to use UTF-8 encoding but sqlite3.exe gives me a syntax error while reading the SQL file.

Is there any solution to fix this?

Could you please trim your SQL down to the fields required to reproduce the problem? — user647772
– user647772, Commented Aug 16, 2012 at 7:30
How did you run in your console? Just tried the same thing but it seems to work. care to show us your environment variables, too? — Yasushi Shoji
– Yasushi Shoji, Commented Aug 16, 2012 at 7:40
I save the sql statement using notepad ++ in ANSI mode. Then in the console,.read the sql file. I am just using a plain sqlite3 in windows — Derek Long
– Derek Long, Commented Aug 16, 2012 at 7:50
What kind of error did you get when you tried utf-8 with notepad++? I assume your .sql file has different encoding. (I have no idea about windows, but é worked on my linux box) — Yasushi Shoji
– Yasushi Shoji, Commented Aug 16, 2012 at 7:59

Yasushi Shoji · Accepted Answer · 2012-08-16 08:08:00Z

1

The encoding UTF-8 in notepad++ has BOM, which sqlite3.exe does not know about. Try using UTF-8 without BOM.

answered Aug 16, 2012 at 8:08

Yasushi Shoji

4,3421 gold badge30 silver badges50 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Derek Long Over a year ago

ok it works now, after converting everything to UTF-8 without BOM. Arigato Gozaimasu

Collectives™ on Stack Overflow

Data ends up with incorrect encoding when reading SQL from a .sql file instead of executing it in SQLite Browser

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related