Commits

Branch selector

 main

User selector

lucidrains

Datepicker

All time

Commit History

Commits on Nov 24, 2024

• make value residual learned

  lucidrains

  committed
  56373c0

Commits on Nov 20, 2024

• allow for qk norm to be turned off for na vit nested tensor

  lucidrains

  committed
  24196a3

Commits on Nov 19, 2024

• readme

  lucidrains

  committed
  f6d7287

Commits on Nov 10, 2024

• fix tests

  lucidrains

  committed
  d47c57e

• update minimum version for nested tensor of NaViT

  lucidrains

  committed
  0449865

Commits on Nov 8, 2024

• update comment for navit 3d

  lucidrains

  committed
  6693d47

Commits on Oct 31, 2024

• fix value residual

  lucidrains

  committed
  141239c

Commits on Oct 28, 2024

• add value residual based simple vit

  lucidrains

  committed
  0b5c9b4

Commits on Oct 11, 2024

• fix multiheaded qk rmsnorm in nViT

  lucidrains

  committed
  e300cdd

Commits on Oct 10, 2024

• go all the way with the normalized vit, fix some scales

  lucidrains

  committed
  36ddc7a

• cite for hypersphere vit adapted from ngpt

  lucidrains

  committed
  1d1a63f

• go for multi-headed rmsnorm for the qknorm on hypersphere vit

  lucidrains

  committed
  74b6200

Commits on Oct 9, 2024

• add a hypersphere vit, adapted from https://arxiv.org/abs/2410.01131

  lucidrains

  committed
  f50d7d1

Commits on Oct 4, 2024

• address lucidrains#330

  lucidrains

  committed
  82f2fa7

Commits on Aug 28, 2024

• add register tokens to the nested tensor 3d na vit example for researcher

  lucidrains

  committed
  fcb9501

Commits on Aug 22, 2024

• 1.7.11

  lucidrains

  committed
  c4651a3

Commits on Aug 21, 2024

• 3d version of navit nested tensor

  lucidrains

  committed
  5e808f4

Commits on Aug 20, 2024

• fix tests

  Show description for bed48b5
  lucidrains

  authored
  bed48b5

• Nested navit (lucidrains#325)

  Show description for 73199ab
  lucidrains

  committed
  73199ab

Commits on Aug 7, 2024

• 1.7.5

  lucidrains

  committed
  4f22eae

• add the u-vit implementation with simple vit + register tokens

  lucidrains

  committed
  dfc8df6

Commits on Jul 20, 2024

• attention re-use in lookup vit should use pre-softmax attention matrix

  lucidrains

  committed
  9992a61

Commits on Jul 19, 2024

• when cross attending in look vit, make sure context tokens are normalized

  lucidrains

  committed
  4b2c00c

• norm not needed when reusing attention in lookvit

  lucidrains

  committed
  ec6c48b

• 1.7.1

  lucidrains

  committed
  547bf94

• add lookup vit, cite, document later

  lucidrains

  committed
  bd72b58

Commits on Jun 11, 2024

• fix t2t vit having two layernorms, and make final layernorm in distillation wrapper configurable, default to False for vit

  lucidrains

  committed
  e3256d7

Commits on May 11, 2024

• rotary needs to be done with full precision to be safe

  lucidrains

  committed
  90be723

Commits on May 2, 2024

• address lucidrains#300

  lucidrains

  committed
  bca88e9

Commits on Apr 18, 2024

• address lucidrains#306

  lucidrains

  committed
  96f66d2

Commits on Apr 17, 2024

• address lucidrains#304

  lucidrains

  committed
  12249dc

Commits on Dec 23, 2023

• address lucidrains#292

  lucidrains

  committed
  5578ac4

Commits on Nov 15, 2023

• share an idea that should be tried if it has not been

  lucidrains

  committed
  d446a41

Commits on Oct 25, 2023

• allow channels to be customizable for cvt

  lucidrains

  committed
  0ad09c4

Commits on Oct 24, 2023

• 1.6.2

  lucidrains

  authored
  92b6932

Pagination

PreviousNext