ytiam
Follow
Stars
A collection of various deep learning architectures, models, and tips
Implements Low-Rank Adaptation(LoRA) Finetuning from scratch
Code Repository for Machine Learning with PyTorch and Scikit-Learn
Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
Pretrain, finetune ANY AI model of ANY size on multiple GPUs, TPUs with zero code changes.
An annotated implementation of the Transformer paper.
Open clone of OpenAI's unreleased WebText dataset scraper. This version uses pushshift.io files instead of the API for speed.
Flet enables developers to easily build realtime web, mobile and desktop apps in Python. No frontend experience required.
Quickly rewrite git repository history (filter-branch replacement)
Simple, unified interface to multiple Generative AI providers
Video+code lecture on building nanoGPT from scratch
Development repository for the Triton language and compiler
A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
Collection of links, tutorials and best practices of how to collect the data and build end-to-end RLHF system to finetune Generative AI models
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Implementation of papers in 100 lines of code.
Summarize existing representative LLMs text datasets.
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
🐙 Guides, papers, lecture, notebooks and resources for prompt engineering
This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. RAG systems combine information retrieval with generative models to provide accurate and cont…
The fundamental package for scientific computing with Python.
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
Unsupervised text tokenizer for Neural Network-based text generation.
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step