Advertisement
Guest User

Untitled

a guest
Nov 21st, 2019
100
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.41 KB | None | 0 0
  1. def my_func(df):
  2. #mach iwas mit dem df
  3. return df
  4.  
  5. dfs = func_to_generate_df_chunks(df) #<- liste mit deinen chunks die concurrent laufen sollen
  6.  
  7. #MultiProcessing:
  8. from concurrent.futures import ProcessPoolExecutor
  9. num_processes = 40
  10. with ProcessPoolExecutor(40) as pool:
  11. #liste mit processes:
  12. futures = [pool.submit(my_func, df) for df in dfs]
  13. result = pd.concat([future.result() for future in futures])
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement