Popular repositories Loading

1. llama llama Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++

2. neural-compressor neural-compressor Public

   Forked from intel/neural-compressor

   SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

   Python

3. MNN MNN Public

   Forked from alibaba/MNN

   MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba

   C++