Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 24, 2024

• make value residual learned

  lucidrains

  committed
  56373c0

Commits on Nov 20, 2024

• allow for qk norm to be turned off for na vit nested tensor

  lucidrains

  committed
  24196a3

Commits on Nov 10, 2024

• fix tests

  lucidrains

  committed
  d47c57e

• update minimum version for nested tensor of NaViT

  lucidrains

  committed
  0449865

Commits on Nov 8, 2024

• update comment for navit 3d

  lucidrains

  committed
  6693d47

Commits on Oct 31, 2024

• fix value residual

  lucidrains

  committed
  141239c

Commits on Oct 28, 2024

• add value residual based simple vit

  lucidrains

  committed
  0b5c9b4

Commits on Oct 11, 2024

• fix multiheaded qk rmsnorm in nViT

  lucidrains

  committed
  e300cdd

Commits on Oct 10, 2024

• go all the way with the normalized vit, fix some scales

  lucidrains

  committed
  36ddc7a

• go for multi-headed rmsnorm for the qknorm on hypersphere vit

  lucidrains

  committed
  74b6200

Commits on Oct 9, 2024

• add a hypersphere vit, adapted from https://arxiv.org/abs/2410.01131

  lucidrains

  committed
  f50d7d1

Commits on Oct 4, 2024

• address lucidrains#330

  lucidrains

  committed
  82f2fa7

Commits on Aug 28, 2024

• add register tokens to the nested tensor 3d na vit example for researcher

  lucidrains

  committed
  fcb9501

Commits on Aug 22, 2024

• Add ViViT variant with factorized self-attention (lucidrains#327)

  Show description for 9d43e4d
  roydenwa

  authored
  9d43e4d

Commits on Aug 21, 2024

• 3d version of navit nested tensor

  lucidrains

  committed
  5e808f4

Commits on Aug 20, 2024

• Nested navit (lucidrains#325)

  Show description for 73199ab
  lucidrains

  committed
  73199ab

Commits on Aug 7, 2024

• add the u-vit implementation with simple vit + register tokens

  lucidrains

  committed
  dfc8df6

Commits on Jul 20, 2024

• attention re-use in lookup vit should use pre-softmax attention matrix

  lucidrains

  committed
  9992a61

Commits on Jul 19, 2024

• when cross attending in look vit, make sure context tokens are normalized

  lucidrains

  committed
  4b2c00c

• norm not needed when reusing attention in lookvit

  lucidrains

  committed
  ec6c48b

• add lookup vit, cite, document later

  lucidrains

  committed
  bd72b58

Commits on Jun 11, 2024

• fix t2t vit having two layernorms, and make final layernorm in distillation wrapper configurable, default to False for vit

  lucidrains

  committed
  e3256d7

Commits on May 11, 2024

• rotary needs to be done with full precision to be safe

  lucidrains

  committed
  90be723

Commits on May 2, 2024

• address lucidrains#300

  lucidrains

  committed
  bca88e9

Commits on Apr 18, 2024

• address lucidrains#306

  lucidrains

  committed
  96f66d2

Commits on Apr 17, 2024

• address lucidrains#304

  lucidrains

  committed
  12249dc

Commits on Dec 23, 2023

• address lucidrains#292

  lucidrains

  committed
  5578ac4

Commits on Nov 15, 2023

• share an idea that should be tried if it has not been

  lucidrains

  committed
  d446a41

Commits on Oct 25, 2023

• allow channels to be customizable for cvt

  lucidrains

  committed
  0ad09c4

Commits on Oct 24, 2023

• Fix typo in LayerNorm (lucidrains#285)

  Show description for fb4ac25
  l0wgear

  authored
  fb4ac25

Commits on Oct 20, 2023

• no longer needed with einops 0.7

  lucidrains

  committed
  53fe345

Commits on Oct 13, 2023

• add xcit (lucidrains#284)

  Show description for 1616288
  lucidrains

  authored
  1616288

Commits on Oct 6, 2023

• give a learned bias to and from registers for maxvit + register token variant

  lucidrains

  committed
  bbb24e3

• improvise a max vit with register tokens

  lucidrains

  committed
  df8733d

Commits on Oct 3, 2023

• document in readme later

  lucidrains

  committed
  680d446

Pagination

PreviousNext