sqlalchemy wtih python ThreadPool and Flask

Question

I have a database of images that need to be processed. Each image takes around a minute to process. I'm trying to make it multi-threaded. I'm having trouble entering data into the database in a worker thread. For some reason, the data isn't saved.

Here is what the code looks like.

images = Images.query.all()

images_ = []
for image in images:
    images_.append(image)

pool = ThreadPool()
pool.map(dostuff, (images_)) 
pool.close() 
pool.join()

def dostuff(image):
    # do stuff
    image.done = True
    db.session.commit()

Any ideas what could be happening? I also tried to pass the session into dostuff(image, session) but that didn't work either. Any help is appreciated!

Q. Qiao · Accepted Answer · 2018-08-23 23:06:37Z

1

Did you add the image to session?

def dostuff(image):
    # do stuff
    image.done = True
    db.session.add(image)
    db.session.commit()

edited Aug 23, 2018 at 23:06

answered Aug 23, 2018 at 20:56

Q. Qiao

8477 silver badges19 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

sqlalchemy wtih python ThreadPool and Flask

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related