On Manjaro’s stable branch, cuda version is 12.6.3. However, the driver version is 550.144.03-1 which only support CUDA toolkit 12.4 according to Nvidia’s documentation. Running nvidia-smi shows tha CUDA version is 12.4, and you run nvcc --version and it shows that the CUDA toolkit version is 12.6.3.
I’m not sure if this cause the following issue, but when I build and run mistral.rs I got the following error
Error: DriverError(CUDA_ERROR_UNSUPPORTED_PTX_VERSION, "the provided PTX was compiled with an unsupported toolchain.")
which caused by the mismatch between the versions of CUDA toolkit and driver.
I solve this issue by downgrading the cuda and cuda-tools to 12.4.1-4.