Pinned Loading

1. FlatQuant_mlm FlatQuant_mlm Public

   Forked from ruikangliu/FlatQuant

   Official PyTorch implementation of FlatQuant: Flatness Matters for LLM Quantization

   Python

2. lmquant_MLM lmquant_MLM Public

   Forked from mit-han-lab/deepcompressor

   Python

3. opencompass opencompass Public

   Forked from open-compass/opencompass

   OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

   Python

4. AutoGPTQ_mlm AutoGPTQ_mlm Public

   Forked from AutoGPTQ/AutoGPTQ

   An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

   Jupyter Notebook