Install ROCm 6.1

„Oobabooga text generation webui“ requires a 6.1.x-Version of ROCm. On the version list cersion 6.1.2 is the last listed 6.1 version, so I chose that one.

A to new kernel (>6.5) needs to be removed, so that the compilation of kernel modules during the installation can succeed. (see here)

Furthermore, you need the kernel headers, which can be installed with:


sudo apt install "linux-headers-$(uname -r)" "linux-modules-extra-$(uname -r)"

Your user needs to be added to two groups:


sudo usermod -a -G render,video $LOGNAME

Now you can download the script with the AMDGPU installer and install it:


sudo apt update
wget https://repo.radeon.com/amdgpu-install/6.1.2/ubuntu/jammy/amdgpu-install_6.1.60102-1_all.deb
sudo apt install -y ./amdgpu-install_6.1.60102-1_all.deb

You start the main installation process with:


sudo amdgpu-install -y --usecase=dkms,graphics,multimedia,multimediasdk,rocm,rocmdev,rocmdevtools,lrt,hip,hiplibsdk,mllib,mlsdk

Lastly, you need to add the directory of the ROCm installation to your PATH:


sudo nano ~/.bashrc

# add to the end of the file:

export "PATH=$PATH:/opt/amdgpu/bin:/opt/rocm-6.1.2/bin"

Now you need to reboot your PC. Afterwards test your installation with:


rocminfo

Source: