Skip to content

Latest commit

 

History

History
53 lines (39 loc) · 1.32 KB

ipu.md

File metadata and controls

53 lines (39 loc) · 1.32 KB

IPU部署库编译

FastDeploy当前在IPU环境仅支持Linux下的Paddle Inference后端推理。

C++ SDK编译安装

Linux编译需满足

  • gcc/g++ >= 5.4(推荐8.2)
  • cmake >= 3.16.0, < 3.23.0
  • popart >= 3.0.0
git clone https://github.com/PaddlePaddle/FastDeploy.git
cd FastDeploy
mkdir build && cd build
cmake .. -DENABLE_PADDLE_BACKEND=ON \
         -DWITH_IPU=ON \
         -DCMAKE_INSTALL_PREFIX=${PWD}/compiled_fastdeploy_sdk \
         -DENABLE_VISION=ON \
         -DENABLE_TEXT=ON
make -j8
make install

编译完成后，即在CMAKE_INSTALL_PREFIX指定的目录下生成C++推理库

Python编译安装

Linux编译过程同样需要满足

  • gcc/g++ >= 5.4(推荐8.2)
  • cmake >= 3.16.0, < 3.23.0
  • popart >= 3.0.0
  • python >= 3.6

所有编译选项通过环境变量导入

git clone https://github.com/PaddlePaddle/FastDeploy.git
cd FastDeploy/python
export ENABLE_VISION=ON
export ENABLE_TEXT=ON
export ENABLE_PADDLE_BACKEND=ON
export WITH_IPU=ON

python setup.py build
python setup.py bdist_wheel

编译完成即会在FastDeploy/python/dist目录下生成编译后的wheel包，直接pip install即可

编译过程中，如若修改编译参数，为避免带来缓存影响，可删除FastDeploy/python目录下的build和.setuptools-cmake-build两个子目录后再重新编译