Commits

Branch selector

 0c68688

User selector

All users

Datepicker

All time

Commit History

Commits on Dec 25, 2020

• bump for release

  lucidrains

  committed
  0c68688

  Copy full SHA for 0c68688

• cleanup

  lucidrains

  committed
  5918f30

  Copy full SHA for 5918f30

• Merge pull request lucidrains#51 from umbertov/main

  Show description for 4a6469e
  lucidrains

  authored
  4a6469e

  Copy full SHA for 4a6469e

• Add class for distillation with efficient attention

  Show description for 5a225c8
  umbertov

  committed
  5a225c8

  Copy full SHA for 5a225c8

Commits on Dec 24, 2020

• add distill diagram

  lucidrains

  committed
  e0007bd

  Copy full SHA for e0007bd

• allow for overriding alpha as well on forward in distillation wrapper

  lucidrains

  committed
  db98ed7

  Copy full SHA for db98ed7

• no grad for teacher in distillation

  lucidrains

  committed
  dc4b332

  Copy full SHA for dc4b332

• Update README.md

  lucidrains

  authored
  aa8f0a7

  Copy full SHA for aa8f0a7

• Update README.md

  lucidrains

  authored
  34e6284

  Copy full SHA for 34e6284

• add knowledge distillation with distillation tokens, in light of new finding from facebook ai

  lucidrains

  committed
  aa9ed24

  Copy full SHA for aa9ed24

• update readme

  lucidrains

  committed
  ea0924e

  Copy full SHA for ea0924e

• allow for mean pool with efficient version too

  lucidrains

  committed
  59787a6

  Copy full SHA for 59787a6

• offer a way to use mean pooling of last layer

  lucidrains

  committed
  2433964

  Copy full SHA for 2433964

Commits on Dec 17, 2020

• fix the dimension per head to be independent of dim and heads, to make sure users do not have it be too small to learn anything

  lucidrains

  committed
  b786029

  Copy full SHA for b786029

Commits on Dec 7, 2020

• simplify mlp head

  lucidrains

  committed
  9624181

  Copy full SHA for 9624181

Commits on Dec 4, 2020

• update diagram

  lucidrains

  committed
  a656a21

  Copy full SHA for a656a21

Commits on Nov 21, 2020

• Merge pull request lucidrains#31 from minhlong94/main

  Show description for f1deb5f
  lucidrains

  authored
  f1deb5f

  Copy full SHA for f1deb5f

• Update README.md

  minhlong94

  authored
  3f50dd7

  Copy full SHA for 3f50dd7

• Update vit_pytorch.py

  minhlong94

  authored
  ee5e4e9

  Copy full SHA for ee5e4e9

Commits on Nov 13, 2020

• remove float(-inf) as masking value

  lucidrains

  committed
  6c8dfc1

  Copy full SHA for 6c8dfc1

Commits on Nov 3, 2020

• authors are now known

  lucidrains

  committed
  4f84ad7

  Copy full SHA for 4f84ad7

• cite

  lucidrains

  committed
  c74bc78

  Copy full SHA for c74bc78

Commits on Oct 29, 2020

• use einops repeat

  lucidrains

  committed
  dc5b89c

  Copy full SHA for dc5b89c

Commits on Oct 27, 2020

• update readme

  lucidrains

  committed
  c1043ab

  Copy full SHA for c1043ab

Commits on Oct 25, 2020

• allow for training on different image sizes, provided images are smaller than what was passed as image_size keyword on init

  lucidrains

  committed
  7a214d7

  Copy full SHA for 7a214d7

Commits on Oct 23, 2020

• more efficient

  lucidrains

  committed
  6d1df1a

  Copy full SHA for 6d1df1a

Commits on Oct 16, 2020

• remove dropout from last linear to logits

  lucidrains

  committed
  d65a8c1

  Copy full SHA for d65a8c1

• assert minimum number of patches

  lucidrains

  committed
  f7c164d

  Copy full SHA for f7c164d

Commits on Oct 14, 2020

• rename ipy notebook

  lucidrains

  committed
  c7b74e0

  Copy full SHA for c7b74e0

• dropouts are more specific and aggressive in the paper, thanks for letting me know @hila-chefer

  lucidrains

  committed
  5b5d98a

  Copy full SHA for 5b5d98a

Commits on Oct 13, 2020

• bump package

  lucidrains

  committed
  b0e4790

  Copy full SHA for b0e4790

• add dropouts

  lucidrains

  committed
  0b2b3fc

  Copy full SHA for 0b2b3fc

Commits on Oct 11, 2020

• Update setup.py

  lucidrains

  authored
  ced464d

  Copy full SHA for ced464d

• Merge pull request lucidrains#4 from adimyth/main

  Show description for 5bf45a2
  lucidrains

  authored
  5bf45a2

  Copy full SHA for 5bf45a2

Commits on Oct 10, 2020

• adds a classification example using 'cats & dogs' data

  adimyth

  committed
  fa32e22

  Copy full SHA for fa32e22

Pagination

Previous

Next