The Triton TensorRT-LLM Backend

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

Transformer related optimization, including BERT, GPT

Ongoing research training transformer language models at scale, including: BERT & GPT-2

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

An Open Source Machine Learning Framework for Everyone

TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.

HugeCTR is a high efficiency GPU framework designed for Click-Through-Rate (CTR) estimating training

Deep Learning Examples

TensorFlow code and pre-trained models for BERT

Caffe2 is a lightweight, modular, and scalable deep learning framework.