Python multiprocessing for shared memory with an array of lists

Question

I need to know if there is a way to share memory for an array of bool lists:

s = Array( 'x' , range(10000000))

What do I have to write instead of x to make it an array of lists whose size is 64. Then I have to manipulate "s" in two different processes like these:

#First

for i in range(0,photoCount):
    db.newDBS.insert_one({ 'photo' : s[i], 'user_id' : ids[i] })

#Second

s[photoCount].append = inPhoto

What should be the type? Any help or suggestion appreciated. Thank you!

CoMartel · Accepted Answer · 2016-08-26 09:51:45Z

2

Python Multiprocessing module allows 2 types of shared variables : Array, which is a simple 1D array of a single dtype, and Value, which is just a single value.

You can design your own shared variables using ctype, if you know your way in C : see the documentation here.

If you just need a 2D Array and you don't want to use ctype shared objects, maybe you could flatten your array in a single list and use multiprocessing.Array instead? Then just reshape when your processing is done.

answered Aug 26, 2016 at 9:51

CoMartel

3,6114 gold badges27 silver badges49 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Python multiprocessing for shared memory with an array of lists

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related