Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Feb 26, 2021

• make it so one can plug performer into t2tvit

  lucidrains

  committed
  1698b7b

  Copy full SHA for 1698b7b

Commits on Feb 24, 2021

• no need to do projection to combine attention heads for T2Ts initial one-headed attention layers

  lucidrains

  committed
  6760d55

  Copy full SHA for 6760d55

Commits on Feb 22, 2021

• add DistillableT2TViT

  lucidrains

  committed
  a828948

  Copy full SHA for a828948

• remove patch size from T2TViT

  lucidrains

  committed
  3744ac6

  Copy full SHA for 3744ac6

• make sure distillation still works

  lucidrains

  committed
  6af7bbc

  Copy full SHA for 6af7bbc

Commits on Feb 20, 2021

• cleanup

  lucidrains

  committed
  05edfff

  Copy full SHA for 05edfff

• add token to token ViT

  lucidrains

  committed
  e3205c0

  Copy full SHA for e3205c0

Commits on Feb 17, 2021

• incept idea for using nystromformer

  lucidrains

  committed
  4fc7365

  Copy full SHA for 4fc7365

• fix for ambiguity in broadcasting mask

  lucidrains

  committed
  3f2cbc6

  Copy full SHA for 3f2cbc6

Commits on Jan 21, 2021

• patch for scaling factor, thanks to @Urkax

  lucidrains

  committed
  85314cf

  Copy full SHA for 85314cf

Commits on Jan 12, 2021

• update readme about non-square images

  lucidrains

  authored
  5db8d9d

  Copy full SHA for 5db8d9d

Commits on Jan 11, 2021

• allow for DistillableVit to still run predictions

  lucidrains

  committed
  e8ca603

  Copy full SHA for e8ca603

Commits on Jan 8, 2021

• link to official repo

  lucidrains

  committed
  1106a2b

  Copy full SHA for 1106a2b

Commits on Jan 4, 2021

• link to resources for vision people

  lucidrains

  committed
  f95fa59

  Copy full SHA for f95fa59

Commits on Dec 28, 2020

• add quote

  lucidrains

  committed
  be1712e

  Copy full SHA for be1712e

• update readme

  lucidrains

  committed
  1a76944

  Copy full SHA for 1a76944

Commits on Dec 26, 2020

• allow distillable efficient vit to restore efficient vit as well

  lucidrains

  committed
  2263b73

  Copy full SHA for 2263b73

Commits on Dec 25, 2020

• offer easy way to turn DistillableViT to ViT at the end of training

  lucidrains

  committed
  74074e2

  Copy full SHA for 74074e2

• bump for release

  lucidrains

  committed
  0c68688

  Copy full SHA for 0c68688

• cleanup

  lucidrains

  committed
  5918f30

  Copy full SHA for 5918f30

• Merge pull request lucidrains#51 from umbertov/main

  Show description for 4a6469e
  lucidrains

  authored
  4a6469e

  Copy full SHA for 4a6469e

• Add class for distillation with efficient attention

  Show description for 5a225c8
  umbertov

  committed
  5a225c8

  Copy full SHA for 5a225c8

Commits on Dec 24, 2020

• add distill diagram

  lucidrains

  committed
  e0007bd

  Copy full SHA for e0007bd

• allow for overriding alpha as well on forward in distillation wrapper

  lucidrains

  committed
  db98ed7

  Copy full SHA for db98ed7

• no grad for teacher in distillation

  lucidrains

  committed
  dc4b332

  Copy full SHA for dc4b332

• Update README.md

  lucidrains

  authored
  aa8f0a7

  Copy full SHA for aa8f0a7

• Update README.md

  lucidrains

  authored
  34e6284

  Copy full SHA for 34e6284

• add knowledge distillation with distillation tokens, in light of new finding from facebook ai

  lucidrains

  committed
  aa9ed24

  Copy full SHA for aa9ed24

• update readme

  lucidrains

  committed
  ea0924e

  Copy full SHA for ea0924e

• allow for mean pool with efficient version too

  lucidrains

  committed
  59787a6

  Copy full SHA for 59787a6

• offer a way to use mean pooling of last layer

  lucidrains

  committed
  2433964

  Copy full SHA for 2433964

Commits on Dec 17, 2020

• fix the dimension per head to be independent of dim and heads, to make sure users do not have it be too small to learn anything

  lucidrains

  committed
  b786029

  Copy full SHA for b786029

Commits on Dec 7, 2020

• simplify mlp head

  lucidrains

  committed
  9624181

  Copy full SHA for 9624181

Commits on Dec 4, 2020

• update diagram

  lucidrains

  committed
  a656a21

  Copy full SHA for a656a21

Commits on Nov 21, 2020

• Merge pull request lucidrains#31 from minhlong94/main

  Show description for f1deb5f
  lucidrains

  authored
  f1deb5f

  Copy full SHA for f1deb5f

Pagination

Previous

Next