A curated list of Large Language Model resources, covering model training, serving, fine-tuning, and building LLM applications.

Vision-Centric Evaluation for Retrieval-Augmented Multimodal Models

VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)

Ongoing research training transformer models at scale

Scalable toolkit for efficient model alignment

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Doc site for Isaac Sim + Jetson HIL hands-on course

A project demonstrating Lidar related AI solutions, including three GPU accelerated Lidar/camera DL networks (PointPillars, CenterPoint, BEVFusion) and the related libs (cuPCL, 3D SparseConvolution…

Repository that contains LLM fine-tuning and deployment scripts along with our research findings.

Repository of the NLP in 3 weeks series starting 2023-12-05

MLX: An array framework for Apple silicon

Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".

Official implementation of "Neuralangelo: High-Fidelity Neural Surface Reconstruction" (CVPR 2023)

Open Source Computer Vision Library

YOLOv5 on Orin DLA

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

NVIDIA DLA-SW, the recipes and tools for running deep learning workloads on NVIDIA DLA cores for inference applications.

ArrayFire: a general purpose GPU library.

[NeurIPS 2023 Oral] Visual Instruction Tuning: LLaVA (Large Language-and-Vision Assistant) built towards GPT-4V level capabilities.

The open source implementation of "NeVA: NeMo Vision and Language Assistant"

VideoLLM: Modeling Video Sequence with Large Language Models

Official PyTorch implementation of ODISE: Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Models [CVPR 2023 Highlight]

Seamless operability between C++11 and Python

O'Reilly Technical Writing Course