Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Oct 11, 2024

• fix multiheaded qk rmsnorm in nViT

  lucidrains

  committed
  e300cdd

Commits on Oct 10, 2024

• go all the way with the normalized vit, fix some scales

  lucidrains

  committed
  36ddc7a

• cite for hypersphere vit adapted from ngpt

  lucidrains

  committed
  1d1a63f

• go for multi-headed rmsnorm for the qknorm on hypersphere vit

  lucidrains

  committed
  74b6200

Commits on Oct 9, 2024

• add a hypersphere vit, adapted from https://arxiv.org/abs/2410.01131

  lucidrains

  committed
  f50d7d1

Commits on Oct 4, 2024

• address lucidrains#330

  lucidrains

  committed
  82f2fa7

Commits on Aug 28, 2024

• add register tokens to the nested tensor 3d na vit example for researcher

  lucidrains

  committed
  fcb9501

Commits on Aug 22, 2024

• 1.7.11

  lucidrains

  committed
  c4651a3

• Add ViViT variant with factorized self-attention (lucidrains#327)

  Show description for 9d43e4d
  roydenwa

  authored
  9d43e4d

Commits on Aug 21, 2024

• 3d version of navit nested tensor

  lucidrains

  committed
  5e808f4

Commits on Aug 20, 2024

• fix tests

  Show description for bed48b5
  lucidrains

  authored
  bed48b5

• Nested navit (lucidrains#325)

  Show description for 73199ab
  lucidrains

  committed
  73199ab

Commits on Aug 7, 2024

• 1.7.5

  lucidrains

  committed
  4f22eae

• add the u-vit implementation with simple vit + register tokens

  lucidrains

  committed
  dfc8df6

Commits on Jul 20, 2024

• attention re-use in lookup vit should use pre-softmax attention matrix

  lucidrains

  committed
  9992a61

Commits on Jul 19, 2024

• when cross attending in look vit, make sure context tokens are normalized

  lucidrains

  committed
  4b2c00c

• norm not needed when reusing attention in lookvit

  lucidrains

  committed
  ec6c48b

• 1.7.1

  lucidrains

  committed
  547bf94

• add lookup vit, cite, document later

  lucidrains

  committed
  bd72b58

Commits on Jun 11, 2024

• fix t2t vit having two layernorms, and make final layernorm in distillation wrapper configurable, default to False for vit

  lucidrains

  committed
  e3256d7

Commits on May 11, 2024

• rotary needs to be done with full precision to be safe

  lucidrains

  committed
  90be723

Commits on May 2, 2024

• address lucidrains#300

  lucidrains

  committed
  bca88e9

Commits on Apr 18, 2024

• address lucidrains#306

  lucidrains

  committed
  96f66d2

Commits on Apr 17, 2024

• address lucidrains#304

  lucidrains

  committed
  12249dc

• Update setup.py (lucidrains#303)

  soumya1729

  authored
  8b8da8d

Commits on Dec 23, 2023

• address lucidrains#292

  lucidrains

  committed
  5578ac4

Commits on Nov 15, 2023

• share an idea that should be tried if it has not been

  lucidrains

  committed
  d446a41

Commits on Oct 25, 2023

• allow channels to be customizable for cvt

  lucidrains

  committed
  0ad09c4

Commits on Oct 24, 2023

• 1.6.2

  lucidrains

  authored
  92b6932

• Fix typo in LayerNorm (lucidrains#285)

  Show description for fb4ac25
  l0wgear

  authored
  fb4ac25

Commits on Oct 20, 2023

• no longer needed with einops 0.7

  lucidrains

  committed
  53fe345

Commits on Oct 19, 2023

• readme

  lucidrains

  authored
  efb9460

Commits on Oct 13, 2023

• add xcit diagram

  lucidrains

  committed
  51310d1

• add xcit (lucidrains#284)

  Show description for 1616288
  lucidrains

  authored
  1616288

Commits on Oct 9, 2023

• Update README.md (lucidrains#283)

  Show description for 9e1e824
  EIFY

  authored
  9e1e824

Pagination

PreviousNext