How do I execute a python script on Heroku?

Question

I have a python script which I only need to run once (I don't want to have to commit it to the repo to send to the Cedar instance).

The Script aggregates data over my Django models and outputs a .csv file.

Normally in AWS, I would scp the script to the server, manage.py shell < script.py, and scp the produced .csv back to my machine.

I understand Heroku file systems are ephemeral, but is there a way to retrieve produced files on Heroku servers without uploading them to S3?

Here's my best shot:

cat script.py | heroku run manage.py shell --app appname

Works for a one line script, but not with line breaks.

Also, the above script will only produce command line output, not return a .csv file.

jraede · Accepted Answer · 2013-12-09 23:49:24Z

3

Heroku doesn't give you write permissions anywhere on your dyno (the only files it writes are the ones it checks out from your master branch when you push an update, and any dependencies). You'll have to upload your output to S3, save it to the log, or find some other delivery mechanism (email?)

answered Dec 9, 2013 at 23:49

jraede

6,9165 gold badges31 silver badges33 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

tbraun89 · Accepted Answer · 2015-06-16 17:53:12Z

3

I wanted to execute a python script manually in heroku one single time. That's how it worked:

import django in your script
add the line django.setup() in your python script (that is important to be able to use the created models in django)
shell command (has to be executed in your git repository): heroku run bash
bash command: export DJANGO_SETTINGS_MODULE=projectsname.settings
bash command: cd projectsname
bash commmand: python yourscriptname.py

edited Jun 16, 2015 at 17:53

tbraun89

2,2343 gold badges26 silver badges47 bronze badges

answered Jun 16, 2015 at 17:11

LaLa

6522 gold badges7 silver badges11 bronze badges

Comments

Remis Haroon - رامز · Accepted Answer · 2021-04-18 11:09:40Z

1

You are nearly there. The issue you are having is more related to how the typical shell syntax works.

You have cat script.py | heroku run manage.py shell --app appname which pipes in the script with no line breaks.

To get your line breaks try this.

heroku run python -c "`cat script.py`" --app appname

The key is wrapping the backticks in double quotes, that way line breaks in the script are preserved.

edited Apr 18, 2021 at 11:09

Remis Haroon - رامز

3,5824 gold badges42 silver badges67 bronze badges

answered Jun 14, 2016 at 14:35

user916367

Collectives™ on Stack Overflow

How do I execute a python script on Heroku?

3 Answers 3

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related