Skip to content

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for Cloud and Edge. Including Vision, Text, Audio and Video 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization and multi-platform multi-framework support.

License

Notifications You must be signed in to change notification settings

alanzhichen/FastDeploy

Repository files navigation

FastDeploy

模型推理就用FastDeploy!

环境要求

  • python >= 3.6
  • cmake >= 3.18
  • gcc >= 8.2
  • cuda >= 11.0(如若需要启用GPU)
  • tensorrt >= 8.4(如若需要启用TensorRT后端)

如何利用FastDeploy快速完成模型部署

如何自行编译FastDeploy

代码提交

提交代码前,先初始化代码环境,在clone代码后,执行

sh commit-prepare.sh

在之后commit代码时,会自动进行代码格式的检查。

About

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for Cloud and Edge. Including Vision, Text, Audio and Video 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization and multi-platform multi-framework support.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C++ 69.9%
  • Python 16.4%
  • CMake 5.6%
  • Java 5.3%
  • Shell 1.4%
  • Batchfile 0.7%
  • Other 0.7%