MQBench is an open-source model quantization toolkit based on PyTorch fx.
The envision of MQBench is to provide:
- SOTA Algorithms. With MQBench, the hardware vendors and researchers can benefit from the latest research progress in academic.
- Powerful Toolkits. With the toolkit, quantization node can be inserted to the original PyTorch module automatically with respect to the specific hardware. After training, the quantized model can be smoothly converted to the format that can inference on the real device.
git clone [email protected]:ModelTC/MQBench.git
cd MQBench
python setup.py installMQBench aims to support (1) various deployable quantization algorithms and (2) hardware backend libraries to facilitate the development of the community.
For the detailed information, please refer to MQBench documentation.
This project is released under the Apache 2.0 license.