Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.

Lowering PyTorch's Memory Consumption for Selective Differentiation

Universal Tensor Operations in Einstein-Inspired Notation for Python.

Sketched matrix decompositions for PyTorch

A little Python script to collect LaTeX sources for upload to the arXiv.

Implementation of Forward Laplacian algorithm in JAX

Python 3.8+ toolbox for submitting jobs to Slurm

Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.

⚡️Optimizing einsum functions in NumPy, Tensorflow, Dask, and more with contraction order optimization.

Home for cuQuantum Python & NVIDIA cuQuantum SDK C++ samples

Automatic High-Order Optimization for Tensors

A list of awesome compiler projects and papers for tensor computation and deep learning.

Import an ICS file into org to include events in your org agenda

Notes for the Numerics of Machine Learning Lecture Course at the University of Tübingen

The Tensor Algebra Compiler (taco) computes sparse tensor expressions on CPUs and GPUs

Package for extracting and mapping the results of every single tensor operation in a PyTorch model in one line of code.

Abstract your array operations.

Hyper optimized contraction trees for large tensor networks and einsums

Run your GitHub Actions locally 🚀

Optimization trajectories in the Tuebingen landscape.

MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvements in both training algorithms and models.

PyTorch implementation of the Hessian-free optimizer

Titlecase Things in Emacs

Second Order Optimization and Curvature Estimation with K-FAC in JAX.

Outliner for taking notes and managing to-do lists