Skip to content

Commit

Permalink
Add KwaiYii-66B results
Browse files Browse the repository at this point in the history
  • Loading branch information
huajingyun authored Sep 18, 2023
1 parent aac17db commit f077bca
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,9 @@ CMMLU是一个综合性的中文评估基准,专门用于评估语言模型在
| 尚未开放测试的模型 |
| [vivoLM-7B](https://developers-ai.vivo.com.cn/) | 61.02 | **81.94** | **78.62** | **79.85** | **78.25** | **75.07** |
| [Galaxy](https://www.zuoyebang.com/) | **69.61** | 74.95 | 78.54 | 77.93 | 73.99 | 74.03 |
| [KwaiYii-66B](https://github.com/kwai/KwaiYii) | 56.70 | 79.43 | 72.84 | 74.43 | 71.11 | 71.12 |
| [Mengzi-7B](https://www.langboat.com/) | 49.59 | 75.27 | 71.36 | 70.52 | 69.23 | 66.41 |
| [KwaiYii-13B](https://github.com/kwai) | 46.54 | 69.22 | 64.49 | 65.09 | 63.10 | 61.73 |
| [KwaiYii-13B](https://github.com/kwai/KwaiYii) | 46.54 | 69.22 | 64.49 | 65.09 | 63.10 | 61.73 |
| [MiLM-6B](https://github.com/XiaoMi/MiLM-6B/) | 46.85 | 61.12 | 61.68 | 58.84 | 59.39 | 57.17 |
| [MiLM-1.3B](https://github.com/XiaoMi/MiLM-6B/) | 35.59 | 49.58 | 49.03 | 47.56 | 48.17 | 45.39 |
| Random | 25.00 | 25.00 | 25.00 | 25.00 | 25.00 | 25.00 |
Expand All @@ -81,8 +82,9 @@ CMMLU是一个综合性的中文评估基准,专门用于评估语言模型在
| 尚未开放测试的模型 |
| [Galaxy](https://www.zuoyebang.com/) | **69.38** | 75.33 | **78.27** | **78.19** | 73.25 | **73.85** |
| [vivoLM-7B](https://developers-ai.vivo.com.cn/) | 58.72 | **77.15** | 74.86 | 76.88 | **74.58** | 71.66 |
| [KwaiYii-66B](https://github.com/kwai/KwaiYii) | 55.20 | 77.10 | 71.74 | 73.30 | 71.27 | 69.96 |
| [Mengzi-7B](https://www.langboat.com/) | 49.49 | 75.84 | 72.32 | 70.87 | 70.00 | 66.88 |
| [KwaiYii-13B](https://github.com/kwai) | 46.82 | 69.35 | 63.42 | 64.02 | 63.26 | 61.22 |
| [KwaiYii-13B](https://github.com/kwai/KwaiYii) | 46.82 | 69.35 | 63.42 | 64.02 | 63.26 | 61.22 |
| [MiLM-6B](https://github.com/XiaoMi/MiLM-6B/) | 48.88 | 63.49 | 66.20 | 62.14 | 62.07 | 60.37 |
| [MiLM-1.3B](https://github.com/XiaoMi/MiLM-6B/) | 40.51 | 54.82 | 54.15 | 53.99 | 52.26 | 50.79 |
| Random | 25.00 | 25.00 | 25.00 | 25.00 | 25. | 25.00 |
Expand Down

0 comments on commit f077bca

Please sign in to comment.