memory - Python: Multiprocessing Map takes longer to complete last few processes -

in python, i'm trying run 150-200 processes. have these 150 things in array, , i've split array multiple arrays of 10 elements each.

now, run multiprocessing map, 10 elements @ time. once 10 complete, go onto next 10, , on.

now, problem: ninth , tenth process slower rest. there reason that? not doing efficient way?

** won't able share code this. have ideas why may happening?

thanks in advance.

this due way pool.map distributes data among workers. use chunksize=1 parameter, i.e. map(...,..., chunksize=1).

Ben