Skip to content

Commit

Permalink
Merge branch 'master' of github.com:AIDungeon/Javascript-GPT-3-Encoder
Browse files Browse the repository at this point in the history
  • Loading branch information
nickwalton committed Sep 4, 2020
2 parents 7f3cb26 + 9fa3183 commit dbb5b2e
Showing 1 changed file with 9 additions and 1 deletion.
10 changes: 9 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,12 @@
# Javascript-GPT-3-Encoder
GPT-3-Encoder
Javascript BPE Encoder Decoder for GPT-2 / GPT-3

## About
GPT-2 and GPT-3 use byte pair encoding to turn text into a serires of integers to feed into the model. This is a javascript implementation of OpenAI's original python encoder/decoder which can be found [here](https://github.com/openai/gpt-2)

## How to Use
1. [Install Node](https://nodejs.org/en/download/package-manager/)
2. `clone https://github.com/AIDungeon/GPT-3-Encoder.git`
3. `cd GPT-3-Encoder.git`
4. `npm install`
5. `node example.js`

0 comments on commit dbb5b2e

Please sign in to comment.