A high-throughput and memory-efficient inference and serving engine for LLMs

Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.