Skip to content

Commit

Permalink
Added redirection to wiki, for the repo - as this repo still maintain…
Browse files Browse the repository at this point in the history
…s the top spot for SEO, having a redirection to a more "new user friendly" site will help with onboarding
  • Loading branch information
PicoCreator authored Sep 16, 2023
1 parent 8a6b4d2 commit c66d7f1
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,7 @@
# The RWKV Language Model (and my LM tricks)

> If you are new to RWKV, it would be better to find out more about us via our wiki first here: https://wiki.rwkv.com/
## RWKV: Parallelizable RNN with Transformer-level LLM Performance (pronounced as "RwaKuv", from 4 major params: R W K V)

RWKV is an RNN with Transformer-level LLM performance, which can also be directly trained like a GPT transformer (parallelizable). And it's 100% attention-free. You only need the hidden state at position t to compute the state at position t+1. You can use the "GPT" mode to quickly compute the hidden state for the "RNN" mode.
Expand Down

0 comments on commit c66d7f1

Please sign in to comment.