error when inserting dataframe into MS-SQL with Python

Question

I want to insert a pandas dataframe into MS-SQL using pypyodbc. Here is my code:

Create a dataframe at first:

df = pd.DataFrame({'C1': [11, 21, 31],
                    'C2': [12, 22, 32],
                    'C3': [13, 23, 33]})
tablename = tb

and then insert dataframe into MS-SQL

def insertDFtoSQL(df,tablename):
    con = ppo.connect(r'Driver={SQL Server};
                     'r'Server=se;'
                      r'Database=db;'
                      r'Trusted_Connection=yes;')
    cols = ','.join([k for k in df.dtypes.index])
    params = ','.join('?' * len(df.columns))
    sql = 'INSERT INTO {0} ({1}) VALUES ({2})'.format(tablename, cols, params)
    data = [tuple(x) for x in df.values]
    con.cursor().executemany(sql, data)
    con.commit()
    con.close()

this code resulted in an error message that said "type object is not subscriptable".

However, everything would be right if I used

data1 = [(11,12,13),(22,23,24),(32,33,34)]

to replace data in executemany(sql, data) as executemany(sql, data1)

Any ideas about it?

Gord Thompson · Accepted Answer · 2017-09-07 14:24:52Z

4

df.values is a <class 'numpy.ndarray'>, and when you do

data = [tuple(x) for x in df.values]

you get a list of tuples containing elements of type <class 'numpy.int64'>. pypyodbc is expecting the tuples to contain "normal" Python types, so you'll need to use

data = [tuple(int(col) for col in row) for row in df.values]

to convert the numbers into plain old int values.

edited Sep 7, 2017 at 14:24

answered Sep 7, 2017 at 14:16

Gord Thompson

125k38 gold badges251 silver badges458 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

potatout Over a year ago

Hi, @Gord Thompson, Thank you for your help. it is a great solution for my issue.

Collectives™ on Stack Overflow

error when inserting dataframe into MS-SQL with Python

1 Answer 1

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related