Skip to content

Latest commit

 

History

History
16 lines (13 loc) · 1.4 KB

multi-cpu-processing.md

File metadata and controls

16 lines (13 loc) · 1.4 KB

Multi CPU Processing

Numpy on multi process, and how to use it.

  1. Pandas on multi process
  2. ***Dask - youtube intros
    1. Diagnostic dashboards
    2. Ditributed sklearn (amazing)
  3. Dask vs swifter vs vectorize
    1. Dask is dask
    2. Swifter will attempt to understand if dask or pandas apply should be used, looks like its using multi cpu so it may not be just using dask on the backend?
    3. Vectorize is just another option
  4. Multi process cpu example
  5. Medium on MP, using MP pool, Ray etc.
  6. Async (multi process/thread/coroutines/asyncio)