Parse requests.get() output into a pandas dataframe

Question

I am following a tutorial an am stuck at parsing the output of requests.get()

My goal is to connect to the API below to pull historical crypto-currency prices and put them into a pandas dataframe for further analysis.

[API: https://www.cryptocompare.com/api/#-api-data-histoday-]

Here's what I have.

import requests
response = requests.get("https://min-api.cryptocompare.com/data/histodayfsym=ETC&tsym=USD&limit=10&aggregate=3&e=CCCAGG") 



print(response.text)

Now I want to output into a dataframe...

pd.DataFrame.from_dict(response)

But I get... PandasError: DataFrame constructor not properly called!

response isn't a dictionary - maybe .from_dict(response.json())? — jonrsharpe
– jonrsharpe, Commented May 22, 2017 at 22:06
That gets me a bit closer! Now it is in a df, but the keys and values are all out of order... I need the timestamp to be in a datetime format I think then call the the index — Merv Merzoug
– Merv Merzoug, Commented May 22, 2017 at 22:09

Manuel Antonio Sanchez · Accepted Answer · 2022-06-13 11:43:29Z

6

You can use the json package to convert to dict:

import requests
from json import loads
import pandas as pd

response = requests.get("https://min-api.cryptocompare.com/data/histodayfsym=ETC&tsym=USD&limit=10&aggregate=3&e=CCCAGG") 

dic = loads(response.text)

print(type(dic))

pd.DataFrame.from_dict(dic)

However as jonrsharpe noted, a much more simple way would be:

import requests
import pandas as pd

response = requests.get("https://min-api.cryptocompare.com/data/histodayfsym=ETC&tsym=USD&limit=10&aggregate=3&e=CCCAGG") 


print(type(response.json()))
pd.DataFrame.from_dict(response.json())

edited Jun 13, 2022 at 11:43

Manuel Antonio Sanchez

34 bronze badges

answered May 22, 2017 at 22:11

RandomHash

6817 silver badges22 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

jonrsharpe Over a year ago

You actually do not: docs.python-requests.org/en/master/user/quickstart/…

RandomHash Over a year ago

Indeed, i stand corrected :), i have update answer to reflect this

Collectives™ on Stack Overflow

Parse requests.get() output into a pandas dataframe

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related