Scraping Financial Data Yahoo - Python

Question

I am currently trying to scrape BitCoin historical financial data from Yahoo Finance while still being able to choose when I want to start mining the data. My code is as follows, however an error appears telling me "HTTP Error 404: Not Found" ... Can you tell me where this error is coming from and how to fix it?

import time
import datetime
import pandas as pd

period1 = int(time.mktime(datetime.datetime(2020, 1, 1, 23, 59).timetuple()))
period2 = int(time.mktime(datetime.datetime(2022, 1, 1, 23, 59).timetuple()))

basic_url = 'https://fr.finance.yahoo.com/quote/BTC-USD/historyperiod1=1606780800&period2=1609372800&interval=1dk&filter=history&frequency=1wk&includeAdjustedClose=true'
modified_url = 'https://fr.finance.yahoo.com/quote/BTC-USD/history?period1={period1}&period2={period2}&interval=1d&filter=history&frequency=1d&includeAdjustedClose=true'

df=pd.read_csv(modified_url)
df

Thanks in advance !

Thibaut

pinegulf · Accepted Answer · 2022-01-04 10:52:16Z

1

Your logic is sound.

However your address seems to be wrong. I checked their site and direct working link is:

modified_url =f'https://query1.finance.yahoo.com/v7/finance/download/BTC-USD?period1={period1}&period2={period2}&interval=1d&events=history&includeAdjustedClose=true'

Edit:

Since you have converted into Integer already there is no need for f-string. Also try not to use variables as 'a'. They are pain to figure out later.

input_year = int(input("A partir de quelle année voulez-vous commencer le scraping de données?\n"))
period1 = int(time.mktime(datetime.datetime(input_year, 1, 1, 23, 59).timetuple()))

edited Jan 4, 2022 at 10:52

answered Jan 4, 2022 at 9:59

pinegulf

1,3941 gold badge15 silver badges41 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Thibaut Turlan Over a year ago

All right thanks ! I have another question on the same script. I added another answer on the topic. Can you see it ?

pinegulf Over a year ago

@ThibautTurlan Addressed. Also try to edit your original question. This way question is more useable by others.

zeoin · Accepted Answer · 2022-01-04 09:58:35Z

1

If you try and visit the URL on your browser then you can see the problem. It doesn't go anywhere and is re-directed - So 404.

To fix it use a URL that works. Perhaps you have made a mistake in the GET params?

answered Jan 4, 2022 at 9:58

zeoin

111 bronze badge

Collectives™ on Stack Overflow

Scraping Financial Data Yahoo - Python

2 Answers 2

2 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related