Skip to content

Tags: lucidrains/product-key-memory

Tags

0.2.11

Toggle 0.2.11's commit message
add non competitive gates

0.2.10

Toggle 0.2.10's commit message
add an option for layernorming the output of product key memory

0.2.9

Toggle 0.2.9's commit message
ready transformers with customizable product key memory for some inde…

…pendent research

0.2.7

Toggle 0.2.7's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
patch

0.2.6

Toggle 0.2.6's commit message
ability to add gumble noise for stochastic sampling of memories

0.2.5

Toggle 0.2.5's commit message
ability to add gumble noise for stochastic sampling of memories

0.2.4

Toggle 0.2.4's commit message
bring in differentiable topk, based on coordinate descent from wright…

… et al.

0.2.3

Toggle 0.2.3's commit message
bring in differentiable topk, based on coordinate descent from wright…

… et al.

0.2.2

Toggle 0.2.2's commit message
add an attention dropout, default to layernorm on queries