Commits

Branch selector

 main

User selector

lucidrains

Datepicker

All time

Commit History

Commits on Dec 5, 2022

• need simple vit with patch dropout for another project

  lucidrains

  committed
  500e231

Commits on Dec 2, 2022

• add vit with patch dropout, fully embrace structured dropout as multiple papers are now corroborating each other

  lucidrains

  committed
  89e1996

Commits on Dec 1, 2022

• offer 1d versions, in light of https://arxiv.org/abs/2211.14730

  lucidrains

  committed
  2f87c0c

Commits on Oct 29, 2022

• try to fix tests

  lucidrains

  committed
  59c8948

• add a 3d version of cct, addressing lucidrains#238 0.38.1

  lucidrains

  committed
  cb6d749

Commits on Oct 25, 2022

• make sure global average pool can be used for vivit in place of cls token

  lucidrains

  committed
  6ec8fda

Commits on Oct 24, 2022

• add vivit

  lucidrains

  committed
  13fabf9

Commits on Oct 17, 2022

• release updated mae where one can more easily visualize reconstructions, thanks to @Vishu26

  lucidrains

  committed
  5f1a6a0

• add the 3d simple vit

  lucidrains

  committed
  b4853d3

Commits on Oct 16, 2022

• begin extending some of the architectures over to 3d, starting with basic ViT

  lucidrains

  committed
  29fbf0a

Commits on Jul 27, 2022

• add link to Flax translation by @conceptofmind

  lucidrains

  authored
  4b8f5bc

Commits on Jul 16, 2022

• offer way for extractor to return latents without detaching them

  lucidrains

  committed
  f86e052

Commits on Jun 30, 2022

• slightly more clear of einops rearrange for cls token, for lucidrains#224

  lucidrains

  committed
  2fa2b62

Commits on Jun 29, 2022

• follow @arquolo feedback and advice for MaxViT

  lucidrains

  committed
  9f87d1c

Commits on Jun 25, 2022

• fix hidden dimension in MaxViT thanks to @arquolo

  lucidrains

  committed
  2c6dd70

Commits on Jun 19, 2022

• be able to accept a reference to a layer within the model for forward hooking and extracting the embedding output, for regionvit to work with extractor

  lucidrains

  committed
  6460119

• make extractor flexible for layers that output multiple tensors, show CrossViT example

  lucidrains

  committed
  4e62e5f

Commits on May 4, 2022

• add simple vit, from https://arxiv.org/abs/2205.01580

  lucidrains

  committed
  b3e90a2

Commits on May 3, 2022

• add EsViT, by popular request, an alternative to Dino that is compatible with efficient ViTs with accounting for regional self-supervised loss

  lucidrains

  committed
  4ef72fc

Commits on Apr 6, 2022

• fix mbconv residual block

  lucidrains

  committed
  81661e3

• fix maxvit - need feedforwards after attention

  lucidrains

  committed
  13f8e12

• link to maxvit in readme

  lucidrains

  committed
  2d4089c

• maxvit intent to build (lucidrains#211)

  Show description for c7bb5fc
  lucidrains

  authored
  c7bb5fc

• sponsor button

  lucidrains

  authored
  946b19b

Commits on Mar 31, 2022

• let windowed tokens exchange information across heads a la talking heads prior to pointwise attention in sep-vit

  lucidrains

  committed
  d93cd84

• cleanup sepvit

  lucidrains

  committed
  5d4c798

• intent to build (lucidrains#210)

  Show description for d65a742
  lucidrains

  authored
  d65a742

• do not layernorm on last transformer block for scalable vit, as there is already one in mlp head

  lucidrains

  committed
  8c54e01

• complete learnable memory ViT, for efficient fine-tuning and potentially plays into continual learning

  lucidrains

  committed
  df656fe

Commits on Mar 30, 2022

• correct need for post-attention dropout

  lucidrains

  committed
  4e6a42a

Commits on Mar 28, 2022

• link to tensorflow2 translation by @taki0112

  lucidrains

  committed
  6d7298d

Commits on Mar 26, 2022

• CCT allow for rectangular images

  lucidrains

  committed
  9cd56ff

Commits on Mar 23, 2022

• add proposed parallel vit from facebook ai for exploration purposes

  lucidrains

  committed
  2aae406

• fix window size of none for scalable vit for rectangular images

  lucidrains

  committed
  c2b2db2

• some better defaults for scalable vit

  lucidrains

  committed
  719048d

Pagination

PreviousNext