-
Notifications
You must be signed in to change notification settings - Fork 23
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
2 changed files
with
4 additions
and
3 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,11 +1,11 @@ | ||
## Saved Networks | ||
|
||
When a checkpoint is saved to a directory `<out_dir>/<checkpoint_name>`, it will contain | ||
- `unquantised.bin`, the raw floating point (`f32`) parameters of the network | ||
- `raw.bin`, the raw floating point (`f32`) parameters of the network | ||
- `quantised.bin`, the quantised network, padded to be a multiple of 64 bytes | ||
- `optimiser_state`, the internal state of the optimiser | ||
- `optimiser_state/`, the internal state of the optimiser | ||
|
||
If quantisation fails (due to integer overflow), then it will not save the quantised network, but training will be otherwise unaffected. | ||
|
||
For the two network files, the format of these is `(layer 1 weights)(layer 1 biases)(layer 2 weights)...` stored | ||
If you are using the `TrainerBuilder`, the format of the two network files is `(layer 1 weights)(layer 1 biases)(layer 2 weights)...` stored | ||
contiguously, with the weights matrices being stored column-major. |