Name		Name	Last commit message	Last commit date
parent directory ..
cuda		cuda
misc		misc
mmlu_dev_dataset		mmlu_dev_dataset
mmlu_test_dataset		mmlu_test_dataset
README.md		README.md
rwkv_mmlu_eval.py		rwkv_mmlu_eval.py
rwkv_v7_demo.py		rwkv_v7_demo.py
rwkv_v7_demo_fast.py		rwkv_v7_demo_fast.py
rwkv_v7_demo_rnn.py		rwkv_v7_demo_rnn.py

README.md

RWKV-7 "Goose" x070 (final release, "rc4a")

Train RWKV-7: use /RWKV-v5/ and use --my_testing "x070" in demo-training-prepare.sh and demo-training-run.sh

Inference Demo:

https://github.com/BlinkDL/RWKV-LM/blob/main/RWKV-v7/rwkv_v7_demo.py (GPT mode)

https://github.com/BlinkDL/RWKV-LM/blob/main/RWKV-v7/rwkv_v7_demo_rnn.py (RNN mode)

https://github.com/BlinkDL/RWKV-LM/blob/main/RWKV-v7/rwkv_v7_demo_fast.py (Both mode, fastest)

Please check https://github.com/BlinkDL/modded-nanogpt-rwkv for speedrun experiments.