distributed: Walkthrough of apex distributed data parallel utilities.
FP16_Optimizer_simple: Simple examples demonstrating various use cases of FP16_Optimizer
to automatically manage master parameters and static or dynamic loss scaling.
imagenet: Example based on https://github.com/pytorch/examples/tree/master/imagenet showing the use of FP16_Optimizer
, as well as manual management of master parameters and loss scaling for illustration/comparison.
word_language_model: Example based on https://github.com/pytorch/examples/tree/master/word_language_model showing the use of FP16_Optimizer
, as well as manual management of master parameters and loss scaling for illustration/comparison.
docker: Example of a minimal Dockerfile that installs Apex on top of an existing container.