Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Aug 14, 2023

• just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point

  lucidrains

  committed
  8208c85

  Copy full SHA for 8208c85

• 1.4.2

  lucidrains

  committed
  4264efd

  Copy full SHA for 4264efd

• add a simple vit with qknorm, since authors seem to be promoting the technique on twitter

  lucidrains

  committed
  b194359

  Copy full SHA for b194359

Commits on Aug 10, 2023

• fix linear head in simple vit, thanks to @atkos

  lucidrains

  committed
  950c901

  Copy full SHA for 950c901

Commits on Aug 9, 2023

• address lucidrains#274

  lucidrains

  committed
  3e5d1be

  Copy full SHA for 3e5d1be

Commits on Jul 25, 2023

• wrap up NaViT

  lucidrains

  committed
  6e2393d

  Copy full SHA for 6e2393d

Commits on Jul 24, 2023

• one can pass a callback to token_dropout_prob for NaViT that takes in height and width and calculate appropriate dropout rate

  lucidrains

  committed
  32974c3

  Copy full SHA for 32974c3

• add constant token dropout for NaViT

  lucidrains

  committed
  17675e0

  Copy full SHA for 17675e0

• release NaViT

  lucidrains

  committed
  598cffa

  Copy full SHA for 598cffa

• begin work on NaViT (lucidrains#273)

  Show description for 23820bc
  lucidrains

  authored
  23820bc

  Copy full SHA for 23820bc

• 1.2.5

  lucidrains

  committed
  e9ca1f4

  Copy full SHA for e9ca1f4

• Support SimpleViT as encoder in MAE (lucidrains#272)

  Show description for d4daf7b
  roydenwa

  authored
  d4daf7b

  Copy full SHA for d4daf7b

Commits on Jun 28, 2023

• fix mpp

  lucidrains

  committed
  9e3fec2

  Copy full SHA for 9e3fec2

Commits on May 20, 2023

• address lucidrains#266

  lucidrains

  committed
  ce4bcd0

  Copy full SHA for ce4bcd0

Commits on May 8, 2023

• enforce latest einops

  lucidrains

  committed
  ad4ca19

  Copy full SHA for ad4ca19

Commits on Mar 19, 2023

• fix tests

  lucidrains

  committed
  e1b08c1

  Copy full SHA for e1b08c1

Commits on Mar 18, 2023

• add a version of simple vit using flash attention

  lucidrains

  committed
  c59843d

  Copy full SHA for c59843d

Commits on Mar 8, 2023

• separate a simple vit from mp3, so that simple vit can be used after being pretrained

  lucidrains

  committed
  9a8e509

  Copy full SHA for 9a8e509

Commits on Mar 7, 2023

• release mp3, contributed by @Vishu26

  lucidrains

  committed
  258dd8c

  Copy full SHA for 258dd8c

• Add Masked Position Prediction (lucidrains#260)

  Show description for 4218556
  Vishu26

  authored
  4218556

  Copy full SHA for 4218556

Commits on Mar 5, 2023

• typo

  lucidrains

  authored
  f621c2b

  Copy full SHA for f621c2b

Commits on Feb 10, 2023

• double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm

  lucidrains

  committed
  5699ed7

  Copy full SHA for 5699ed7

Commits on Feb 6, 2023

• seeing a signal with dual patchnorm in another repository, fully incorporate

  lucidrains

  committed
  46dcaf2

  Copy full SHA for 46dcaf2

Commits on Feb 3, 2023

• adopt dual patchnorm paper for as many vit as applicable, release 1.0.0

  lucidrains

  committed
  bdaf2d1

  Copy full SHA for bdaf2d1

Commits on Dec 5, 2022

• need simple vit with patch dropout for another project

  lucidrains

  committed
  500e231

  Copy full SHA for 500e231

Commits on Dec 2, 2022

• add vit with patch dropout, fully embrace structured dropout as multiple papers are now corroborating each other

  lucidrains

  committed
  89e1996

  Copy full SHA for 89e1996

Commits on Dec 1, 2022

• offer 1d versions, in light of https://arxiv.org/abs/2211.14730

  lucidrains

  committed
  2f87c0c

  Copy full SHA for 2f87c0c

Commits on Oct 29, 2022

• try to fix tests

  lucidrains

  committed
  59c8948

  Copy full SHA for 59c8948

• add a 3d version of cct, addressing lucidrains#238 0.38.1

  lucidrains

  committed
  cb6d749

  Copy full SHA for cb6d749

Commits on Oct 25, 2022

• make sure global average pool can be used for vivit in place of cls token

  lucidrains

  committed
  6ec8fda

  Copy full SHA for 6ec8fda

Commits on Oct 24, 2022

• add vivit

  lucidrains

  committed
  13fabf9

  Copy full SHA for 13fabf9

Commits on Oct 17, 2022

• Improving Readability (lucidrains#220)

  Show description for c0eb4c0
  ryanrussell

  authored
  c0eb4c0

  Copy full SHA for c0eb4c0

• release updated mae where one can more easily visualize reconstructions, thanks to @Vishu26

  lucidrains

  committed
  5f1a6a0

  Copy full SHA for 5f1a6a0

• Update mae.py (lucidrains#242)

  Show description for 9a95e79
  Vishu26

  authored
  9a95e79

  Copy full SHA for 9a95e79

• add the 3d simple vit

  lucidrains

  committed
  b4853d3

  Copy full SHA for b4853d3

Pagination

Previous

Next