How to call a method on every object in a list in parallel in Python

Question

I have a list of custom objects and I want to apply a method on each object which alters the internal memory of the objects. I want to be able to do this in parallel without having to return the objects afterwards.

Essentially I would like to have the equivalent of the for(/each) statement below but in parallel.

for env, p, v in zip(envs, policy, value):
    env.step(p, v)

Use lambda functions.

LazyCoder
– LazyCoder

2019-07-26 11:13:14 +00:00
Commented Jul 26, 2019 at 11:13 — LazyCoder
– LazyCoder, Commented Jul 26, 2019 at 11:13

Boris W · Accepted Answer · 2019-07-26 11:31:35Z

2

Since pure python does not allow multithreading with really parallel execution due to the global interpreter lock (https://realpython.com/python-gil/), you won't be able to execute your for-loop in parallel without inter-process communication, i.e. returning the object afterwards.

However, as the link says, this might change in the future. Alternatively you could use an alternative Python interpreter.

answered Jul 26, 2019 at 11:31

Boris W

1113 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to call a method on every object in a list in parallel in Python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related