Skip to content

Commit

Permalink
Update chainer/link_hooks/weight_standardization.py
Browse files Browse the repository at this point in the history
Co-Authored-By: hitsgub <[email protected]>
  • Loading branch information
crcrpar and hitsgub committed Apr 11, 2019
1 parent 23e5f5d commit d6dd61d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion chainer/link_hooks/weight_standardization.py
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ class WeightStandardization(link_hook.LinkHook):
This hook standardizes a weight by *weight statistics*.
This link hook implements a "weight standardization" which computes the
mean and variance along axis "output channels", then normalize by these
mean and variance along axis "output channels", then normalizes by these
statistics.
That improves training by reducing the Lipschitz constants of the loss and
the gradients like batch normalization but without relying on large batch
Expand Down

0 comments on commit d6dd61d

Please sign in to comment.