Skip to content

Evaluate different methods speed on a pandas DataFrame to find which one is better for us.

Notifications You must be signed in to change notification settings

MINIMALaq/FasterPandasOperation

Repository files navigation

FasterPandasOperation

These notebooks are for https://towardsdatascience.com/how-to-simply-make-an-operation-on-pandas-dataframe-faster-adaea5e41e96 .

In NumericTimeTest.ipynb I evaluated speed of iterrows() vs itertuples() vs apply() vs map() vs np.vectorize() vs np.where() vs numba for the same task. The difference is huge. The best method is 480X faster than the worst method on the same function.

In nonNumericTimeTest.ipynb I evaluated speed of iterrows() vs itertuples() vs apply() vs map() vs np.vectorize() vs np.where() vs pandas.Series.map() for the same task.

I added some usecases of Jupyter Notebook's Fortran magic in FortranMagic.

About

Evaluate different methods speed on a pandas DataFrame to find which one is better for us.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published