A course on aligning smol models.

🍎APPL: A Prompt Programming Language. Seamlessly integrate LLMs with programs.

SGLang is a fast serving framework for large language models and vision language models.

🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library

[PGAI@CIKM 2023] PyTorch Implementation of LlamaRec: Two-Stage Recommendation using Large Language Models for Ranking

한국의 음악 스트리밍 사이트인 "melon"의 (2000~2023)년도 차트를 크롤링해 분석한다.

Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"

한국어 언어모델 다분야 사고력 벤치마크

Next-Token Prediction is All You Need

[NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models

Python API for Kiwi

A native PyTorch Library for large model training

Top2Vec learns jointly embedded topic, document and word vectors.

MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents [EMNLP 2024]

Efficient Triton Kernels for LLM Training

📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery 🧑‍🔬

Code for "FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models (ACL 2024)"

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Official repository for EXAONE built by LG AI Research

🧬 RegMix: Data Mixture as Regression for Language Model Pre-training

Implementation for "Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs"

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers

Retrieval and Retrieval-augmented LLMs

Utilities intended for use with Llama models.