Model Parallel DistributedModelParallel is the main API for distributed training with TorchRec optimizations. .. automodule:: torchrec.distributed.model_parallel .. autoclass:: DistributedModelParallel :members: