Exporting SQL query results to pandas dataframe

Question

id    date       temp       prcp
1   2015-01-01  -27.18      0
1   2015-01-02  -25.9       1.03
1   2015-01-03  -17.89      9.44
1   2015-01-04  -17.89      9.44
1   2015-01-05  -17.89      9.44

import dataset
import pandas as pd

db = dataset.connect(path_to_database_on_AWS)
res = db.query(SELECT * FROM tbl WHERE id=1 and date >= '2015-01-03' and date <= '2015-01-05')
pd.read_sql(res, con=db)

In the above code, I am using the query method from the python dataset library to read in from a table and then want to export the results as a pandas dataframe, however, I get this bug:

*** AttributeError: 'Database' object has no attribute 'cursor'

How do I export query results to pandas dataframe?

What is db here? Can you show how it's created? Typically an .execute() method is called, and not .query(). — mechanical_meat
– mechanical_meat, Commented Apr 1, 2017 at 1:27
thanks @bernie, I am using the query method from the dataset library: dataset.readthedocs.io/en/latest/…. Also, added code to show how I am connecting to database using python dataset library — user308827
– user308827, Commented Apr 1, 2017 at 1:53
That library isn't supported by .read_sql(). Are you able to use another way to execute your query? — mechanical_meat
– mechanical_meat, Commented Apr 1, 2017 at 1:57
thanks @bernie, it is built on SQL Alchemy, isn't that supported by read_sql()? — user308827
– user308827, Commented Apr 1, 2017 at 1:58

MoQ93 · Accepted Answer · 2017-04-01 02:15:10Z

1

You could do something like this:

   import sqlite3
   import pandas as pd
   con = sqlite3.connect('path_to_your_sql')
   myFrames = pd.read_sql_query('your query', con)

Edit: for non sqlite db you could use this for the connection:

from sqlalchemy import create_engine
con = create_engine('dialect+driver://username:password@host:port/database')

docs for create_engine

edited Apr 1, 2017 at 2:15

answered Apr 1, 2017 at 2:09

MoQ93

3412 silver badges12 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Exporting SQL query results to pandas dataframe

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related