Code behind the work "Single Cortical Neurons as Deep Artificial Neural Networks", published in Neuron 2021

PyTorch Implementation of Diffusion Schrodinger Bridge Matching

PyTorch Implementation of DSB for Score Based Generative Modeling. Experiments managed using Hydra.

Meta-learning local synaptic plasticity for continual familiarity detection

Supervised learning with predictive coding (Whittington & Bogacz 2017)

[NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"

Clean, minimal, accessible reproduction of DeepSeek R1-Zero

Rotary Transformer

Code for 'Credit Assignment Through Broadcasting a Global Error Vector' in NeurIPS 2021

Fast, flexible and easy to use probabilistic modelling in Python.

SAM: Sharpness-Aware Minimization (PyTorch)

Measures of distance between two probability density functions

Sampling points and doing multi-dimensional scaling in Hyperbolic space

Deep and online learning with spiking neural networks in Python

Predictive coding for sequential memory

Matplotlib styles for scientific plotting

Python module for Simulated Annealing optimization

Dynamical Similarity Analysis code accompanying the paper "Beyond Geometry: comparing the temporal structure of computation in neural circuits via dynamical similarity analysis"

Approximating neural network loss landscapes in low-dimensional parameter subspaces for PyTorch

Video+code lecture on building nanoGPT from scratch

Hopfield Networks is All You Need

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Teaching

Some methods for comparing network representations in deep learning and neuroscience.