Sqlite database non-ascii character error with python SQLalchemy library

Question

When i use sqlite3 database with sqlalchemy library, i got this error

sqlalchemy.exc.ProgrammingError: (ProgrammingError) 
You must not use 8-bit bytestrings unless you use a text_factory that can
interpret 8-bit bytestrings (like text_factory = str). 
It is highly recommended that you instead just switch your application 
to Unicode strings. 
u'INSERT INTO model_pair (user, password) VALUES (?, ?)' ('\xebE\xc2\xe4.\[email protected]', '123456')

and here is some test data:

 呆呆 [email protected]        11111                                                             
  è?“è¨€    [email protected]        11111 
wwwj55572@gg?€?       11111

I have configured database encoding as utf-8 or gbk but neither success when insert, i try str.decode('gbk'), it will stuck on char like € and get error like above.

anyone tell me how get around this error ?

For those experiencing the same issue, please check my answer stackoverflow.com/questions/23876342/… — cdagli
– cdagli, Commented Jul 21, 2016 at 20:04

Dima Tisnek · Accepted Answer · 2012-02-14 09:48:58Z

3

try to change '\xebE\xc2\xe4.\[email protected]' to u'\xebE\xc2\xe4.\[email protected]'

also, you could try to do '\xebE\xc2\xe4.\[email protected]'.decode("utf-8"), but it gives an error "invalid continuation byte", perhaps your string is not valid utf-8 after all?

btw, do mention is you are running python 2.x or 3.x, there is a difference.

answered Feb 14, 2012 at 9:48

Dima Tisnek

11.9k4 gold badges73 silver badges129 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

CodeFarmer Over a year ago

i use python2.7 and i am trying to insert sql statement, instead of using ORM model to import data. Behide the science cause trouble

Dima Tisnek Over a year ago

did you try u'\x...' or u"\N{EURO SIGN}"?

Collectives™ on Stack Overflow

Sqlite database non-ascii character error with python SQLalchemy library

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related