Provably Optimal Memory Capacity for Modern Hopfield Models

This is an official implementation of the NeurIPS 2024 paper:

---

This code was tested on Python 3.10.10. To install, follow these steps:

1. In a virtual environment, first install Cython: pip install cython
2. Install the requirements: pip install -r requirements.txt
3. Run the corresponding scripts

Instruction

Countours and Basins of Attraction

Run countours.py and basins.py

Metastable State

Run MNIST_metastable.py, synthetic_metastable.py

Numerical Simulation

Run bound_simulation.py

---

Citation

If you have any question regarding our paper or codes, please feel free to start an issue or email Dennis Wu ([email protected]). If you find our work useful, please kindly cite our paper: