Automatically updating data from an API to an SQL database?

Question

I have data coming from an API in JSON format which I then run a few functions/transformations in python and then insert the data in to an SQL database through pandas & SQLalchemy.

Now, how do I automatically do this at the end of every day, without having to open up the script and run it manually?

Supposing this script runs on a server, what about using a crontab? i.e. put the script to run daily at 23:00hrs (0 23 * * *) — AnhellO
– AnhellO, Commented Jun 29, 2020 at 21:45

Edgar Ramírez Mondragón · Accepted Answer · 2020-06-29 23:13:05Z

1

You can use crontab on a server (or your Linux/Mac laptop but it will not run the script if its turned off of course).

You can run crontab -e to edit the crontab file. Add something like the following to run your script everyday at 11 PM:

0 23 * * * ~/myscript.py

crontab guru is a useful resource to try different schedule expressions.

answered Jun 29, 2020 at 23:13

Edgar Ramírez Mondragón

3,0613 gold badges23 silver badges36 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Automatically updating data from an API to an SQL database?

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related