Skip to content

Commit

Permalink
FIX (README) Fix format for HumanEval
Browse files Browse the repository at this point in the history
  • Loading branch information
SeungyounShin committed Aug 27, 2023
1 parent 32f17b0 commit b1c3bc2
Showing 1 changed file with 2 additions and 3 deletions.
5 changes: 2 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,16 +21,15 @@ This project allows LLM to generate code, execute it, receive feedback, debug, a

- 🔥🔥🔥[2023/08/27] We're thrilled to announce that our **Llama2 Code Interpreter-70B-V1.0** model achieved a remarkable **70.12pass@1** on the [HumanEval Benchmarks](https://github.com/openai/human-eval).

## Llama2 Code Interpreter Performance Metrics

### HumanEval
**HumanEval**

| Model | Score |
|-------------------------------|--------|
| Codellama instruct 7b | 34.8% |
| Codellama instruct 7b - finetuning | 70.12% |

### GSM8K
**GSM8K**

| Model | Score |
|-------------------------------|--------|
Expand Down

0 comments on commit b1c3bc2

Please sign in to comment.