Threaded code on mod_python

Question

I have written a Django app that makes use of Python threading to create a web spider, the spider operates as a series of threads to check links.

When I run this app using the django test server (built in), the app runs fine and the threads seem to start and stop on time.

However, running the app on Apache it seems the threads aren't kicking off and running (after about 80 seconds there should be a queued database update and these changes aren't occuring).

Does anyone have an idea what I'm missing here?

-- Edit: My question is, how does Apache handle threaded applications, i.e. is there a limit on how many threads can be run from a single app?

Any help would be appreciated!

How is Django connected to Apache? mod_python? mod_wsgi? Mod_fastcgi? — S.Lott
– S.Lott, Commented Dec 12, 2008 at 22:25

Martin v. Löwis · Accepted Answer · 2008-12-12 22:51:37Z

3

Most likely, you are missing the creation of new processes. Apache will not run in a single process, but fork new processes for requests every now and then (depending on a dozen or so configuration parameters). If you run django in each process, they will share no memory, and the results produced in one worker won't be visible to any of the others. In addition, the Apache process might terminate (on idle, or after a certain time), discarding your in-memory results.

answered Dec 12, 2008 at 22:51

Martin v. Löwis

128k20 gold badges205 silver badges238 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Threaded code on mod_python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related