Skip to content

Commit

Permalink
vision transfo
Browse files Browse the repository at this point in the history
  • Loading branch information
Adamdad committed Sep 5, 2024
1 parent 18dabe2 commit 7aedc02
Show file tree
Hide file tree
Showing 4 changed files with 2,504 additions and 1 deletion.
6 changes: 5 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1 +1,5 @@
# kat
# Kolmogorov–Arnold Transformer: A PyTorch Implementation

![KAT](assets/KAT.png)

This is a PyTorch/GPU implementation of the paper **Kolmogorov–Arnold Transformer (KAT)**, which replace the MLP layers in vision transformer with KAN layers.
Binary file added assets/KAT.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading

0 comments on commit 7aedc02

Please sign in to comment.