Run python script outside of webserver

Question

My django app is running on an nginx/uwsgi stack. My goal is to start a python script which runs independently from the web server. By hitting a endpoint on django, it would thus fire off a non blocking script.

I've looked into using python subprocess/Popen - i'm just not sure if the script is still running on the web server or not via subprocess.Popen()

You could use Twisted, but you'd have to do a bit of wizardry with the Crochet library. It really depends on what you're trying to do. But if you're simply trying to run a script in a different process, you can just use Multiprocessing. — notorious.no
– notorious.no, Commented Apr 6, 2015 at 19:53
Well, you could use celery.readthedocs.org/en/latest, that integrates nicely with Django. The asynchronous task would then run the background, and commit its potential result to a backend. — Balthazar Rouberol
– Balthazar Rouberol, Commented Apr 6, 2015 at 19:59

Daniel Roseman · Accepted Answer · 2015-04-06 20:52:38Z

3

This is exactly what Celery is for. You should use that.

answered Apr 6, 2015 at 20:52

Daniel Roseman

602k68 gold badges910 silver badges923 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Hacking Life Over a year ago

So celery can run background tasks that wont die even if a uwsgi process serving django is running on dies?

Hacking Life Over a year ago

After some doc reading - I didn't realize celery was separately daemonized, thus exactly what I needed. When using uwsgi however, I did find their Mules concept to be on par with celery.

Collectives™ on Stack Overflow

Run python script outside of webserver

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related