Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Jul 27, 2022

• add link to Flax translation by @conceptofmind

  lucidrains

  authored
  4b8f5bc

  Copy full SHA for 4b8f5bc

Commits on Jul 16, 2022

• offer way for extractor to return latents without detaching them

  lucidrains

  committed
  f86e052

  Copy full SHA for f86e052

Commits on Jun 30, 2022

• slightly more clear of einops rearrange for cls token, for lucidrains#224

  lucidrains

  committed
  2fa2b62

  Copy full SHA for 2fa2b62

Commits on Jun 29, 2022

• follow @arquolo feedback and advice for MaxViT

  lucidrains

  committed
  9f87d1c

  Copy full SHA for 9f87d1c

Commits on Jun 25, 2022

• fix hidden dimension in MaxViT thanks to @arquolo

  lucidrains

  committed
  2c6dd70

  Copy full SHA for 2c6dd70

Commits on Jun 19, 2022

• be able to accept a reference to a layer within the model for forward hooking and extracting the embedding output, for regionvit to work with extractor

  lucidrains

  committed
  6460119

  Copy full SHA for 6460119

• make extractor flexible for layers that output multiple tensors, show CrossViT example

  lucidrains

  committed
  4e62e5f

  Copy full SHA for 4e62e5f

Commits on May 4, 2022

• add simple vit, from https://arxiv.org/abs/2205.01580

  lucidrains

  committed
  b3e90a2

  Copy full SHA for b3e90a2

Commits on May 3, 2022

• add EsViT, by popular request, an alternative to Dino that is compatible with efficient ViTs with accounting for regional self-supervised loss

  lucidrains

  committed
  4ef72fc

  Copy full SHA for 4ef72fc

Commits on Apr 7, 2022

• fix bibtex typo (lucidrains#212)

  vztu

  authored
  c2aab05

  Copy full SHA for c2aab05

Commits on Apr 6, 2022

• fix mbconv residual block

  lucidrains

  committed
  81661e3

  Copy full SHA for 81661e3

• fix maxvit - need feedforwards after attention

  lucidrains

  committed
  13f8e12

  Copy full SHA for 13f8e12

• link to maxvit in readme

  lucidrains

  committed
  2d4089c

  Copy full SHA for 2d4089c

• maxvit intent to build (lucidrains#211)

  Show description for c7bb5fc
  lucidrains

  authored
  c7bb5fc

  Copy full SHA for c7bb5fc

• sponsor button

  lucidrains

  authored
  946b19b

  Copy full SHA for 946b19b

Commits on Mar 31, 2022

• let windowed tokens exchange information across heads a la talking heads prior to pointwise attention in sep-vit

  lucidrains

  committed
  d93cd84

  Copy full SHA for d93cd84

• cleanup sepvit

  lucidrains

  committed
  5d4c798

  Copy full SHA for 5d4c798

• intent to build (lucidrains#210)

  Show description for d65a742
  lucidrains

  authored
  d65a742

  Copy full SHA for d65a742

• do not layernorm on last transformer block for scalable vit, as there is already one in mlp head

  lucidrains

  committed
  8c54e01

  Copy full SHA for 8c54e01

• complete learnable memory ViT, for efficient fine-tuning and potentially plays into continual learning

  lucidrains

  committed
  df656fe

  Copy full SHA for df656fe

Commits on Mar 30, 2022

• correct need for post-attention dropout

  lucidrains

  committed
  4e6a42a

  Copy full SHA for 4e6a42a

Commits on Mar 28, 2022

• link to tensorflow2 translation by @taki0112

  lucidrains

  committed
  6d7298d

  Copy full SHA for 6d7298d

Commits on Mar 26, 2022

• CCT allow for rectangular images

  lucidrains

  committed
  9cd56ff

  Copy full SHA for 9cd56ff

Commits on Mar 23, 2022

• add proposed parallel vit from facebook ai for exploration purposes

  lucidrains

  committed
  2aae406

  Copy full SHA for 2aae406

• fix window size of none for scalable vit for rectangular images

  lucidrains

  committed
  c2b2db2

  Copy full SHA for c2b2db2

• some better defaults for scalable vit

  lucidrains

  committed
  719048d

  Copy full SHA for 719048d

• add scalable vit, from bytedance AI

  lucidrains

  committed
  d27721a

  Copy full SHA for d27721a

Commits on Mar 22, 2022

• update to einops 0.4, which is torchscript jit friendly

  lucidrains

  committed
  cb22cbb

  Copy full SHA for cb22cbb

Commits on Mar 2, 2022

• add patch merger

  lucidrains

  committed
  6db20de

  Copy full SHA for 6db20de

Commits on Jan 31, 2022

• allow for rectangular images for efficient adapter

  lucidrains

  committed
  1bae5d3

  Copy full SHA for 1bae5d3

Commits on Jan 29, 2022

• return None from extractor if no attention layers

  lucidrains

  committed
  25b3842

  Copy full SHA for 25b3842

Commits on Jan 25, 2022

• epsilon should be inside square root

  lucidrains

  committed
  64a07f5

  Copy full SHA for 64a07f5

Commits on Jan 23, 2022

• fix block repeats in readme example for Nest

  lucidrains

  committed
  126d204

  Copy full SHA for 126d204

Commits on Jan 22, 2022

• fix feature maps in Nest, thanks to @MarkYangjiayi

  lucidrains

  committed
  c1528ac

  Copy full SHA for c1528ac

Commits on Jan 6, 2022

• decoder positional embedding needs to be reapplied https://twitter.com/giffmana/status/1479195631587631104

  lucidrains

  committed
  1cc0f18

  Copy full SHA for 1cc0f18

Pagination

Previous

Next