This guide was updated as of 25.01.2021 due to new version of tensorflow-rocm being incompatible.
This guide will show you how to set up your clean Ubuntu 20.4.1 LTS OS to be ready to run Tensorflow projects, using ROCm to take advantage of the power of your RX580 graphics card (or any gfx803) in a tested, easy and fast way (It should work on other supported Ubuntu versions and other graphic cards too, with only slight changes).
It is basically a resume of the official guide by AMD, and the unofficial guide by Mathieu Poliquin. I highly recommend to check those links, in order to understand what you are doing and why.
There is another important thing to notice: In this guide we downgrade ROCm to 3.5.1 since there are some bugs in posterior versions which have not been fixed yet, not at all (bugs: 1, 2). In the case you have a newer version already installed, you will need to remove it first.
Lets get started!
sudo apt autoremove rocm-dkms
- Make sure that all packages are removed under /opt/rocm-xxx
- Check
sudo dpkg -l | grep hsa
(replacehsa
withhip
,llvm
,rocm
androck
). Make sure that all packages are removed withsudo apt purge
. I recommend to do the same for any other additional packages (if you installed anything explicitly). I have occasionally removed the GUI for Ubuntu, so be careful! - Reboot the system
P.S. It's preferrable to do a fresh Ubuntu reinstall instead of removing ROCm - strange bugs may occur.
sudo apt update
sudo apt dist-upgrade
sudo apt install libnuma-dev
sudo reboot
- These commands also upgrade the kernel. Unfortunately, ROCm needs specific kernel to run on (5.4.0-42-generic). To downgrade your kernel:
- Reboot the computer. In GRUB menu select "Additional options for Ubuntu" and select "Boot with kernel 5.4.0-42-generic (This is the default one Ubuntu 20.04 LTS is shipped with). Also memorize all the other kernel versions from the entries of that menu (5.8.0 by the time of writing this article)
- Remove the newer kernels:
sudo apt-get purge *5.8.0*
(and/or any other versions except for the 5.4.0-42-generic) - Reboot and check your kernel version with
uname -r
(it should be 5.4.0-42-generic)
Add the repo and install rocm-dkms:
wget -q -O - http://repo.radeon.com/rocm/apt/3.5.1/rocm.gpg.key | sudo apt-key add -
echo 'deb [arch=amd64] http://repo.radeon.com/rocm/apt/3.5.1/ xenial main' | sudo tee /etc/apt/sources.list.d/rocm.list
sudo apt update
sudo apt install rocm-dkms && sudo reboot
Set user permissions to access video card features:
sudo usermod -a -G video $LOGNAME
sudo usermod -a -G render $LOGNAME
sudo reboot
Add rocm to PATH:
echo 'export PATH=$PATH:/opt/rocm/bin:/opt/rocm/profiler/bin:/opt/rocm/opencl/bin' | sudo tee -a /etc/profile.d/rocm.sh
sudo ldconfig
sudo reboot
- Check your progress: At this point you should be able to enter
rocminfo
into a terminal without getting any error. You should also see your video card name in the command output (something like this):
Name: gfx803
Uuid: GPU-XX
Marketing Name: Ellesmere [Radeon RX 470/480/570/570X/580/580X/590]
You are half the way now!
sudo apt install python3 python3-pip
sudo apt install rocm-libs miopen-hip
pip3 install -Iv tensorflow-rocm==2.2.0
sudo apt install rccl
sudo apt install libtinfo5
sudo reboot
- Check your progress: At this point you should be able to import Tensorflow in Python, make a simple operation, and exit without any error. Try the following in a python interactive session:
import tensorflow as tf
tf.add(2,5)
exit()
You should see something like this:
<tf.Tensor: shape=(), dtype=int32, numpy=7>
- If you see an error:
Then, you can use any workaround from this issue. I have used:
Could not load dynamic library 'libhip_hcc.so'; dlerror: libhip_hcc.so: cannot open shared object file: No such file or directory
This will only temporarily set the variable. If this fix works, you need to permanently set the variable: Linkexport LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/rocm/hip/lib sudo ldconfig
Congrats, your machine is now ready to use tensorflow-rocm! You should still consider testing it with something more complex, like a benchmark.
sudo apt install git
git clone https://github.com/tensorflow/benchmarks
cd ./benchmarks/scripts/tf_cnn_benchmarks
python3 tf_cnn_benchmarks.py --num_gpus=1 --batch_size=32 --model=resnet50
Expect it to take some time (5-10 minutes), specially if it is the first time. You may think you got stuck in the warm up but be patient, it should not take that long next time.
If you see something like the output bellow (numbers may vary a lot) then go and get yourself a taco, you did it!
total images/sec: 87.92
Have fun! :D
Special thanks to Boris Timofeenko for updating this guide.