Scrape Data on chart Python

Question

Do you know how can I scrape the values on the chart data on this page in python? Is it possible or not feasible?

https://platform.napbots.com/strategyDetails/STRAT_BTC_USD_D_2_V2

import requests 
from bs4 import BeautifulSoup
import pandas as pd
import re


url = 'https://platform.napbots.com/strategyDetails/STRAT_BTC_USD_D_2_V2'
response = requests.get(url)
soup = BeautifulSoup(response.text, 'html.parser')

FYI it's scrape (and scraping, scraped, scraper) not scrap — DisappointedByUnaccountableMod
– DisappointedByUnaccountableMod, Commented Apr 22, 2021 at 13:18

Andrej Kesely · Accepted Answer · 2021-03-30 20:32:13Z

2

The data you see in chart is loaded from external URL. You can use this example how to load it:

import json
import requests


url = "https://middle.napbots.com/v1/strategy/details/STRAT_BTC_USD_D_2_V2"
data = requests.get(url).json()

# uncomment this to print all data:
# print(json.dumps(data, indent=4))

for d in data["data"]["performance"]["quotes"]["NapoX BTC AR daily"]:
    print(d["date"], d["last"])

Prints:

...
2021-03-24 8090496.4614
2021-03-25 8090496.4614
2021-03-26 8090496.4614
2021-03-27 7971715.2932
2021-03-28 7959911.2069
2021-03-29 8223204.2625

answered Mar 30, 2021 at 20:32

Andrej Kesely

196k15 gold badges60 silver badges105 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Ric dm Over a year ago

Thank you, amazing, how can I find the external url by myself on the other strategies?

Andrej Kesely Over a year ago

@Ricdm Look at Firefox developer tools->Network tab (or something similar in Chrome). There are all requests that the page is doing - including to external urls

Collectives™ on Stack Overflow

Scrape Data on chart Python

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related