Skip to content

Commit

Permalink
Fix it's/its mistakes
Browse files Browse the repository at this point in the history
  • Loading branch information
bbycroft committed Dec 4, 2023
1 parent 50092bc commit d1d3637
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 4 deletions.
6 changes: 3 additions & 3 deletions src/llm/walkthrough/Walkthrough00_Intro.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@ export function walkthroughIntro(args: IWalkthroughArgs) {

let c0 = commentary(wt, null, 0)`Welcome to the walkthrough of the GPT large language model! Here we'll explore the model _nano-gpt_, with a mere 85,000 parameters.
It's goal is a simple one: take a sequence of six letters: ${embed(ExampleInputOutput)}
Its goal is a simple one: take a sequence of six letters: ${embed(ExampleInputOutput)}
and sort them in alphabetical order, i.e. to "ABBBCC".`;

if (c0.t > 0) {
Expand Down Expand Up @@ -96,9 +96,9 @@ and sort them in alphabetical order, i.e. to "ABBBCC".`;
let tokenStr = c_str('_token_', 0, DimStyle.Token);
let tokenIdxStr = c_str('_token index_', 0, DimStyle.TokenIdx);

commentary(wt, t6)`We call each of these letters a ${tokenStr}, and the set of the model's different tokens make up it's _vocabulary_:${embed(TokenVocab)}
commentary(wt, t6)`We call each of these letters a ${tokenStr}, and the set of the model's different tokens make up its _vocabulary_:${embed(TokenVocab)}
From this table, each token is assigned a number, it's ${tokenIdxStr}. And now we can enter this sequence of numbers into the model:${embed(ExampleTokenValues)}\n`;
From this table, each token is assigned a number, its ${tokenIdxStr}. And now we can enter this sequence of numbers into the model:${embed(ExampleTokenValues)}\n`;
breakAfter();

let t7 = afterTime(null, 1.5, 0.5);
Expand Down
2 changes: 1 addition & 1 deletion src/llm/walkthrough/Walkthrough07_Mlp.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -78,7 +78,7 @@ We then project the vector back down to length ${c_dimRef('C', DimStyle.C)} with
breakAfter();

commentary(wt)`
Like in the self-attention + projection section, we add the result of the MLP to it's input, element-wise.
Like in the self-attention + projection section, we add the result of the MLP to its input, element-wise.
`;
breakAfter();

Expand Down

0 comments on commit d1d3637

Please sign in to comment.