Skip to content

Commit

Permalink
ty lambda labs
Browse files Browse the repository at this point in the history
  • Loading branch information
karpathy committed Jan 3, 2023
1 parent 97fc426 commit 5acba4b
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -114,3 +114,7 @@ Suspiciousness
Results

- Actually reproduce GPT-2 results and have clean configs that reproduce the result. It was estimated ~3 years ago that the training cost of 1.5B model was ~$50K (?). Sounds a bit too high.

# acknowledgements

Thank you [Lambda labs](https://lambdalabs.com) for supporting the training costs of nanoGPT experiments.

0 comments on commit 5acba4b

Please sign in to comment.