Manage sqlite database with git

Question

I have this small project that specifies sqlite as the database choice.

For this particular project, the framework is Django, and the server is hosted by Heroku. In order for the database to work, it must be set up with migration commands and credentials whenever the project is deployed to continuous integration tools or development site.

The question is, that many of these environments do not actually use the my_project.sqlite3 file that comes with the source repository, which we version control with git. How do I incorporate changes to the deployed database? Is a script that set up the database suitable for this scenario? Meanwhile, it is worth notice that there are security credentials that should not appear in a script in unencrypted ways, which makes the situation tricky.

Matthew Gaiser · Accepted Answer · 2019-10-16 05:37:30Z

1

that many of these environments do not actually use the my_project.sqlite3 file that comes with the source repository

If your deployment platform does not support your chosen database, then your development environment should probably be moved to using one of the databases they do support. It is possible to run different databases in development and production, but just seems like the source of headaches.

I have found a number of articles that state that Heroku just doesn't support SQLite in production and instead recommends Postgres.

How do I incorporate changes to the deployed database? Is a script that set up the database suitable for this scenario?

I assume that you are just extracting data from one database to give to another, so yes,as long as that script is a one time batch operation each time the code is updated, then it should be fine. You will want something else if you are adding/manipulating data in production and then exporting it to your git.

Meanwhile, it is worth notice that there are security credentials that should not appear in a script in unencrypted ways

An environment variable should solve that. You set your host machine to have environment variables with your credentials and then just retrieve them within the script. You are looking to have something like this:

# Set environment vars
os.environ['USER'] = 'username'
os.environ['PASSWORD'] = 'password'

# Get environment vars
USER = os.getenv('USER')
PASSWORD = os.environ.get('PASSWORD')

answered Oct 16, 2019 at 5:37

Matthew Gaiser

4,8431 gold badge23 silver badges36 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

jackxujh Over a year ago

Yeah, I read on both Heroku and Django, Postgres is preferred. But for the project we are having, it has to be SQLite for a while, which is just tedious.

jackxujh Over a year ago

When I was talking about credentials, I was thinking about for example tokens for OAuth. How do I store them to be safe?

Matthew Gaiser Over a year ago

@jackxujh supporting that is going to have annoyingly more glue than should be needed

Matthew Gaiser Over a year ago

@jackxujh can you just encrypt them based on a password? It really depends on your use case.

Collectives™ on Stack Overflow

Manage sqlite database with git

1 Answer 1

4 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related