Hey!
I recently installed the Alpaca software on my PC (Manjaro KDE) (runs well). I also wanted to use this on the laptop (Manjaro KDE). Unfortunately, the laptop (Lenovo Yoga 370 - i5 7300, 8 GB RAM, Mesa Intel HD 620) is extremely slow even with a small LLM (Llama 3.2 3b).
Since I’m thinking about getting a new laptop, I’m asking you if an NPU from Manjaro (kernel 6.12.11-1 or 6.13 and higher) is supported or if it would be sufficient to have a dedicated GPU.
Cheers
Oliver
You are asking if Manjaro Linux - suffice the hardware is available - supports AI and the answer is:
Manjaro Linux - on it’s own - does not provide any neural capability or AI.
Manjaro provides the latest upstream kernel on the Edge branch (unstable) and the latest upstream packages (provided by Arch Linux).
If the hardware (with neural capabilities), has upstream kernel support then you can achieve what you want with Manjaro Linux using the - for Linux - available packages.
keep in mind that laptop-gpu’s and laptop cpu’s / npu’s are very power limited. check for “nvidia-jetson” if you’re really interested in reasonable ai’ing but can’t use a conventional desktop-computer.
This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.