Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
hyunwoongko authored Mar 3, 2021
1 parent 5ab860a commit ca1cc14
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -179,7 +179,7 @@ class LayerNorm(nn.Module):
def forward(self, x):
mean = x.mean(-1, keepdim=True)
std = x.std(-1, keepdim=True)
# -1 means last dimension.
# '-1' means last dimension.

out = (x - mean) / (std + self.eps)
out = self.gamma * out + self.beta
Expand Down

0 comments on commit ca1cc14

Please sign in to comment.