TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

Transformer related optimization, including BERT, GPT

Guide for building custom op for TensorFlow

Contrastive Language-Image Pretraining

A TensorFlow Implementation of the Transformer: Attention Is All You Need