I updated to linux66 and installed the drivers again, after completing the setup I tried to install the packages nvidia-container-toolkit nvidia-container-runtime but I got “package not found error”. When I look in the AUR I can’t find the pages with the packages anymore but I don’t find other documentation on how to set up the usage of GPUs with Docker and Kubernetes. The package managers that I use are “yay” and “snap”. How can I get the packages or set up the GPU usage for containers?
This is the documentation I have been using:
- Github repository
- Installation guide
- How to of the setup for docker
- Github of the same issue in other distros
System information:
Currently running: 6.6.19-1-MANJARO (linux66)
The following kernels are installed in your system:
* linux66
System:
Kernel: 6.6.19-1-MANJARO arch: x86_64 bits: 64 compiler: gcc v: 13.2.1
clocksource: tsc avail: hpet,acpi_pm
parameters: BOOT_IMAGE=/boot/vmlinuz-6.6-x86_64
root=UUID=8deeef3a-a561-40dc-9a1d-527d2903e026 rw quiet splash
resume=UUID=b6db44ac-e7a3-47e2-966c-2daea5ace4dd udev.log_priority=3
systemd.unified_cgroup_hierarchy=false
Desktop: KDE Plasma v: 5.27.11 tk: Qt v: 5.15.12 info: frameworks
v: 5.115.0 wm: kwin_x11 vt: 2 dm: SDDM Distro: Manjaro base: Arch Linux
Machine:
Type: Laptop System: ASUSTeK product: ROG Strix G713PI_G713PI v: 1.0
serial: <superuser required>
Mobo: ASUSTeK model: G713PI v: 1.0 serial: <superuser required>
uuid: <superuser required> UEFI: American Megatrends LLC. v: G713PI.324
date: 07/11/2023
Battery:
ID-1: BAT0 charge: 67.1 Wh (80.0%) condition: 83.9/90.0 Wh (93.2%)
volts: 16.5 min: 15.9 model: AS3GWYF3KC GA50358 type: Unknown
serial: <filter> status: not charging
Memory:
System RAM: total: 16 GiB available: 14.84 GiB used: 3.79 GiB (25.5%)
Message: For most reliable report, use superuser + dmidecode.
Array-1: capacity: 128 GiB note: check slots: 2 modules: 2 EC: None
max-module-size: 64 GiB note: est.
Device-1: Channel-A DIMM 0 type: DDR5 detail: synchronous unbuffered
(unregistered) size: 8 GiB speed: 4800 MT/s volts: note: check curr: 1
min: 1 max: 1 width (bits): data: 64 total: 64 manufacturer: SK Hynix
part-no: HMCG66MEBSA095N serial: <filter>
Device-2: Channel-B DIMM 0 type: DDR5 detail: synchronous unbuffered
(unregistered) size: 8 GiB speed: 4800 MT/s volts: note: check curr: 1
min: 1 max: 1 width (bits): data: 64 total: 64 manufacturer: SK Hynix
part-no: HMCG66MEBSA095N serial: <filter>
PCI Slots:
Permissions: Unable to run dmidecode. Root privileges required.
CPU:
Info: model: AMD Ryzen 9 7945HX with Radeon Graphics bits: 64 type: MT MCP
arch: Zen 4 gen: 5 level: v4 note: check built: 2022+ process: TSMC n5 (5nm)
family: 0x19 (25) model-id: 0x61 (97) stepping: 2 microcode: 0xA601203
Topology: cpus: 1x cores: 16 tpc: 2 threads: 32 smt: enabled cache:
L1: 1024 KiB desc: d-16x32 KiB; i-16x32 KiB L2: 16 MiB desc: 16x1024 KiB
L3: 64 MiB desc: 2x32 MiB
Speed (MHz): avg: 1867 high: 5201 min/max: 400/5461 scaling:
driver: amd-pstate-epp governor: powersave cores: 1: 3493 2: 400 3: 400
4: 400 5: 400 6: 3411 7: 5201 8: 400 9: 4739 10: 400 11: 3303 12: 400
13: 400 14: 400 15: 400 16: 400 17: 5053 18: 400 19: 400 20: 4415 21: 400
22: 4532 23: 400 24: 400 25: 400 26: 400 27: 4992 28: 3344 29: 4742
30: 4549 31: 400 32: 400 bogomips: 159765
Flags: 3dnowprefetch abm adx aes amd_lbr_v2 aperfmperf apic arat avic avx
avx2 avx512_bf16 avx512_bitalg avx512_vbmi2 avx512_vnni avx512_vpopcntdq
avx512bw avx512cd avx512dq avx512f avx512ifma avx512vbmi avx512vl bmi1
bmi2 bpext cat_l3 cdp_l3 clflush clflushopt clwb clzero cmov cmp_legacy
constant_tsc cpb cppc cpuid cqm cqm_llc cqm_mbm_local cqm_mbm_total
cqm_occup_llc cr8_legacy cx16 cx8 de decodeassists erms extapic
extd_apicid f16c flush_l1d flushbyasid fma fpu fsgsbase fsrm fxsr fxsr_opt
gfni ht hw_pstate ibpb ibrs ibrs_enhanced ibs invpcid irperf lahf_lm lbrv
lm mba mca mce misalignsse mmx mmxext monitor movbe msr mtrr mwaitx
nonstop_tsc nopl npt nrip_save nx ospke osvw overflow_recov pae pat
pausefilter pclmulqdq pdpe1gb perfctr_core perfctr_llc perfctr_nb
perfmon_v2 pfthreshold pge pku pni popcnt pse pse36 rapl rdpid rdpru
rdrand rdseed rdt_a rdtscp rep_good sep sha_ni skinit smap smca smep ssbd
sse sse2 sse4_1 sse4_2 sse4a ssse3 stibp succor svm svm_lock syscall tce
topoext tsc tsc_scale umip user_shstk v_spec_ctrl v_vmsave_vmload vaes
vgif vmcb_clean vme vmmcall vnmi vpclmulqdq wbnoinvd wdt x2apic x2avic
xgetbv1 xsave xsavec xsaveerptr xsaveopt xsaves
Vulnerabilities:
Type: gather_data_sampling status: Not affected
Type: itlb_multihit status: Not affected
Type: l1tf status: Not affected
Type: mds status: Not affected
Type: meltdown status: Not affected
Type: mmio_stale_data status: Not affected
Type: retbleed status: Not affected
Type: spec_rstack_overflow status: Vulnerable: Safe RET, no microcode
Type: spec_store_bypass mitigation: Speculative Store Bypass disabled via
prctl
Type: spectre_v1 mitigation: usercopy/swapgs barriers and __user pointer
sanitization
Type: spectre_v2 mitigation: Enhanced / Automatic IBRS, IBPB: conditional,
STIBP: always-on, RSB filling, PBRSB-eIBRS: Not affected
Type: srbds status: Not affected
Type: tsx_async_abort status: Not affected
Graphics:
Device-1: NVIDIA AD106M [GeForce RTX 4070 Max-Q / Mobile] vendor: ASUSTeK
driver: nvidia v: 550.54.14 alternate: nouveau,nvidia_drm non-free: 545.xx+
status: current (as of 2024-02) arch: Lovelace code: AD1xx
process: TSMC n4 (5nm) built: 2022+ pcie: gen: 4 speed: 16 GT/s lanes: 8
ports: active: none empty: DP-1, DP-2, HDMI-A-1, eDP-1 bus-ID: 01:00.0
chip-ID: 10de:2860 class-ID: 0300
Device-2: AMD Raphael vendor: ASUSTeK driver: amdgpu v: kernel arch: RDNA-2
code: Navi-2x process: TSMC n7 (7nm) built: 2020-22 pcie: gen: 4
speed: 16 GT/s lanes: 16 ports: active: eDP-2 empty: DP-3,DP-4,DP-5
bus-ID: 08:00.0 chip-ID: 1002:164e class-ID: 0300 temp: 65.0 C
Device-3: IMC Networks USB2.0 HD UVC WebCam driver: uvcvideo type: USB
rev: 2.0 speed: 480 Mb/s lanes: 1 mode: 2.0 bus-ID: 3-1:2 chip-ID: 13d3:5458
class-ID: fe01 serial: <filter>
Display: x11 server: X.Org v: 21.1.11 compositor: kwin_x11 driver: X:
loaded: amdgpu,nvidia unloaded: modesetting,nouveau alternate: fbdev,nv,vesa
dri: radeonsi gpu: amdgpu display-ID: :0 screens: 1
Screen-1: 0 s-res: 2560x1440 s-dpi: 96 s-size: 677x381mm (26.65x15.00")
s-diag: 777mm (30.58") monitors: <missing: xrandr>
Monitor-1: eDP-2 model: MNH301CA3-1 built: 2022 res: 2560x1440 dpi: 171
gamma: 1.2 chroma: red: x: 0.682 y: 0.322 green: x: 0.263 y: 0.690 blue:
x: 0.149 y: 0.059 white: x: 0.314 y: 0.329 size: 381x214mm (15x8.43")
diag: 437mm (17.2") ratio: 16:9 modes: 2560x1440, 1920x1200, 1920x1080,
1600x1200, 1680x1050, 1280x1024, 1440x900, 1280x800, 1280x720, 1024x768,
800x600, 640x480
EDID-Warnings: 1: parse_edid: unknown tag 112
API: EGL v: 1.5 hw: drv: nvidia drv: amd radeonsi platforms: device: 0
drv: nvidia device: 2 drv: radeonsi device: 3 drv: swrast gbm: drv: nvidia
surfaceless: drv: nvidia x11: drv: radeonsi inactive: wayland,device-1
API: OpenGL v: 4.6.0 compat-v: 4.5 vendor: amd mesa v: 24.0.2-manjaro1.1
glx-v: 1.4 direct-render: yes renderer: AMD Radeon Graphics (radeonsi
raphael_mendocino LLVM 16.0.6 DRM 3.54 6.6.19-1-MANJARO)
device-ID: 1002:164e memory: 500 MiB unified: no
API: Vulkan v: 1.3.279 layers: 1 device: 0 type: discrete-gpu name: NVIDIA
GeForce RTX 4070 Laptop GPU driver: nvidia v: 550.54.14
device-ID: 10de:2860 surfaces: xcb,xlib device: 1 type: integrated-gpu
name: AMD Radeon Graphics (RADV RAPHAEL_MENDOCINO) driver: mesa radv
v: 24.0.2-manjaro1.1 device-ID: 1002:164e surfaces: xcb,xlib
Audio:
Device-1: NVIDIA vendor: ASUSTeK driver: snd_hda_intel v: kernel pcie: gen: 4
speed: 16 GT/s lanes: 8 bus-ID: 01:00.1 chip-ID: 10de:22bd class-ID: 0403
Device-2: AMD ACP/ACP3X/ACP6x Audio Coprocessor vendor: ASUSTeK
driver: snd_rpl_pci_acp6x v: kernel alternate: snd_pci_acp3x,
snd_rn_pci_acp3x, snd_pci_acp5x, snd_pci_acp6x, snd_acp_pci, snd_pci_ps,
snd_sof_amd_renoir, snd_sof_amd_rembrandt, snd_sof_amd_vangogh pcie: gen: 4
speed: 16 GT/s lanes: 16 bus-ID: 08:00.5 chip-ID: 1022:15e2 class-ID: 0480
Device-3: AMD Family 17h/19h HD Audio vendor: ASUSTeK driver: snd_hda_intel
v: kernel pcie: gen: 4 speed: 16 GT/s lanes: 16 bus-ID: 08:00.6
chip-ID: 1022:15e3 class-ID: 0403
API: ALSA v: k6.6.19-1-MANJARO status: kernel-api with: aoss
type: oss-emulator tools: alsactl,alsamixer,amixer
Server-1: JACK v: 1.9.22 status: off tools: N/A
Server-2: PipeWire v: 1.0.3 status: off with: pipewire-media-session
status: active tools: pw-cli
Server-3: PulseAudio v: 17.0 status: active with: pulseaudio-alsa
type: plugin tools: pacat,pactl
Network:
Device-1: Realtek RTL8111/8168/8211/8411 PCI Express Gigabit Ethernet
vendor: ASUSTeK RTL8111/8168/8411 driver: r8169 v: kernel pcie: gen: 1
speed: 2.5 GT/s lanes: 1 port: e000 bus-ID: 03:00.0 chip-ID: 10ec:8168
class-ID: 0200
IF: enp3s0 state: down mac: <filter>
Device-2: MEDIATEK MT7922 802.11ax PCI Express Wireless Network Adapter
vendor: Foxconn driver: mt7921e v: kernel pcie: gen: 2 speed: 5 GT/s lanes: 1
bus-ID: 04:00.0 chip-ID: 14c3:0616 class-ID: 0280
IF: wlp4s0 state: up mac: <filter>
IP v4: <filter> type: dynamic noprefixroute scope: global
broadcast: <filter>
IP v6: <filter> type: noprefixroute scope: link
Info: services: NetworkManager, systemd-timesyncd, wpa_supplicant
WAN IP: <filter>
Bluetooth:
Device-1: Foxconn / Hon Hai Wireless_Device driver: btusb v: 0.8 type: USB
rev: 2.1 speed: 480 Mb/s lanes: 1 mode: 2.0 bus-ID: 3-2:3 chip-ID: 0489:e0f6
class-ID: e001 serial: <filter>
Report: rfkill ID: hci0 rfk-id: 0 state: up address: see --recommends
Logical:
Message: No logical block device data found.
RAID:
Message: No RAID data found.
Drives:
Local Storage: total: 953.87 GiB used: 142.63 GiB (15.0%)
SMART Message: Unable to run smartctl. Root privileges required.
ID-1: /dev/nvme0n1 maj-min: 259:0 vendor: Micron model: 2400 MTFDKBA1T0QFM
size: 953.87 GiB block-size: physical: 512 B logical: 512 B speed: 63.2 Gb/s
lanes: 4 tech: SSD serial: <filter> fw-rev: V3MA003 temp: 41.9 C
scheme: GPT
Message: No optical or floppy data found.
Partition:
ID-1: / raw-size: 658.58 GiB size: 647.17 GiB (98.27%)
used: 142.57 GiB (22.0%) fs: ext4 dev: /dev/nvme0n1p4 maj-min: 259:4
label: N/A uuid: 8deeef3a-a561-40dc-9a1d-527d2903e026
ID-2: /boot/efi raw-size: 260 MiB size: 256 MiB (98.46%)
used: 59.2 MiB (23.1%) fs: vfat dev: /dev/nvme0n1p1 maj-min: 259:1
label: SYSTEM uuid: 44DA-F984
Swap:
Kernel: swappiness: 60 (default) cache-pressure: 100 (default) zswap: yes
compressor: zstd max-pool: 20%
ID-1: swap-1 type: partition size: 15.88 GiB used: 0 KiB (0.0%)
priority: -2 dev: /dev/nvme0n1p8 maj-min: 259:8 label: N/A
uuid: b6db44ac-e7a3-47e2-966c-2daea5ace4dd
Unmounted:
ID-1: /dev/nvme0n1p2 maj-min: 259:2 size: 16 MiB fs: <superuser required>
label: N/A uuid: N/A
ID-2: /dev/nvme0n1p3 maj-min: 259:3 size: 254.11 GiB fs: bitlocker
label: N/A uuid: N/A
ID-3: /dev/nvme0n1p5 maj-min: 259:5 size: 800 MiB fs: ntfs label: RECOVERY
uuid: FEF82DD9F82D90C7
ID-4: /dev/nvme0n1p6 maj-min: 259:6 size: 24 GiB fs: ntfs label: RESTORE
uuid: 0EBAFCB4BAFC9983
ID-5: /dev/nvme0n1p7 maj-min: 259:7 size: 260 MiB fs: vfat label: MYASUS
uuid: 6CFC-D573
USB:
Hub-1: 1-0:1 info: hi-speed hub with single TT ports: 2 rev: 2.0
speed: 480 Mb/s (57.2 MiB/s) lanes: 1 mode: 2.0 chip-ID: 1d6b:0002
class-ID: 0900
Hub-2: 2-0:1 info: super-speed hub ports: 2 rev: 3.1
speed: 20 Gb/s (2.33 GiB/s) lanes: 2 mode: 3.2 gen-2x2 chip-ID: 1d6b:0003
class-ID: 0900
Hub-3: 3-0:1 info: hi-speed hub with single TT ports: 2 rev: 2.0
speed: 480 Mb/s (57.2 MiB/s) lanes: 1 mode: 2.0 chip-ID: 1d6b:0002
class-ID: 0900
Device-1: 3-1:2 info: IMC Networks USB2.0 HD UVC WebCam type: video
driver: uvcvideo interfaces: 3 rev: 2.0 speed: 480 Mb/s (57.2 MiB/s) lanes: 1
mode: 2.0 power: 500mA chip-ID: 13d3:5458 class-ID: fe01 serial: <filter>
Device-2: 3-2:3 info: Foxconn / Hon Hai Wireless_Device type: bluetooth
driver: btusb interfaces: 3 rev: 2.1 speed: 480 Mb/s (57.2 MiB/s) lanes: 1
mode: 2.0 power: 100mA chip-ID: 0489:e0f6 class-ID: e001 serial: <filter>
Hub-4: 4-0:1 info: super-speed hub ports: 2 rev: 3.1
speed: 10 Gb/s (1.16 GiB/s) lanes: 1 mode: 3.2 gen-2x1 chip-ID: 1d6b:0003
class-ID: 0900
Hub-5: 5-0:1 info: hi-speed hub with single TT ports: 2 rev: 2.0
speed: 480 Mb/s (57.2 MiB/s) lanes: 1 mode: 2.0 chip-ID: 1d6b:0002
class-ID: 0900
Device-1: 5-2:2 info: Logitech Unifying Receiver type: keyboard,mouse,HID
driver: logitech-djreceiver,usbhid interfaces: 3 rev: 2.0
speed: 12 Mb/s (1.4 MiB/s) lanes: 1 mode: 1.1 power: 98mA
chip-ID: 046d:c52b class-ID: 0300
Hub-6: 6-0:1 info: super-speed hub ports: 2 rev: 3.1
speed: 10 Gb/s (1.16 GiB/s) lanes: 1 mode: 3.2 gen-2x1 chip-ID: 1d6b:0003
class-ID: 0900
Hub-7: 7-0:1 info: hi-speed hub with single TT ports: 1 rev: 2.0
speed: 480 Mb/s (57.2 MiB/s) lanes: 1 mode: 2.0 chip-ID: 1d6b:0002
class-ID: 0900
Device-1: 7-1:2 info: ASUSTek N-KEY Device type: keyboard
driver: asus,usbhid interfaces: 1 rev: 2.0 speed: 12 Mb/s (1.4 MiB/s)
lanes: 1 mode: 1.1 power: 100mA chip-ID: 0b05:19b6 class-ID: 0301
Hub-8: 8-0:1 info: Linux Foundation 3.0 root hub ports: N/A rev: 3.0
speed: 5 Gb/s (596.0 MiB/s) lanes: 1 mode: 3.2 gen-1x1 chip-ID: 1d6b:0003
class-ID: 0900
Sensors:
System Temperatures: cpu: 84.1 C mobo: 46.0 C
Fan Speeds (rpm): cpu: 3500
Repos:
Packages: 1326 pm: pacman pkgs: 1317 libs: 366 tools: pamac,yay pm: flatpak
pkgs: 5 pm: snap pkgs: 4
Active pacman repo servers in: /etc/pacman.d/mirrorlist
1: https://manjaro.ipacct.com/manjaro/stable/$repo/$arch
2: https://manjaro.mirror.wearetriple.com/stable/$repo/$arch
3: https://manjaro.ynh.ovh/stable/$repo/$arch
4: http://manjaro.mirror.ac.za/stable/$repo/$arch
5: https://mirror.it4i.cz/manjaro/stable/$repo/$arch
6: https://mirror.dkm.cz/manjaro/stable/$repo/$arch
7: https://gsl-syd.mm.fcix.net/manjaro/stable/$repo/$arch
8: http://manjaro.mirrors.theom.nz/manjaro/stable/$repo/$arch
Processes:
CPU top: 5 of 519
1: cpu: 180% command: kubelite pid: 88473 mem: 254.8 MiB (1.6%)
2: cpu: 11.5% command: firefox pid: 4385 mem: 551.2 MiB (3.6%)
3: cpu: 9.6% command: k8s-dqlite pid: 996 mem: 231.8 MiB (1.5%)
4: cpu: 2.9% command: firefox pid: 16628 mem: 272.0 MiB (1.7%)
5: cpu: 2.8% command: firefox pid: 55332 mem: 238.1 MiB (1.5%)
Memory top: 5 of 519
1: mem: 551.2 MiB (3.6%) command: firefox pid: 4385 cpu: 11.5%
2: mem: 429.5 MiB (2.8%) command: firefox pid: 4702 cpu: 0.5%
3: mem: 272.0 MiB (1.7%) command: firefox pid: 16628 cpu: 2.9%
4: mem: 262.2 MiB (1.7%) command: plasmashell pid: 2254 cpu: 0.9%
5: mem: 254.8 MiB (1.6%) command: kubelite pid: 88473 cpu: 180%
Info:
Processes: 519 Power: uptime: 13m states: freeze,mem,disk suspend: s2idle
wakeups: 0 hibernate: platform avail: shutdown, reboot, suspend, test_resume
image: 5.93 GiB services: org_kde_powerdevil, power-profiles-daemon,
upowerd Init: systemd v: 255 default: graphical tool: systemctl
Compilers: clang: 16.0.6 gcc: 13.2.1 Shell: Zsh v: 5.9 default: Bash
v: 5.2.26 running-in: konsole inxi: 3.3.33
0000:03:00.0 (0200:10ec:8168) Network controller Realtek Semiconductor Co., Ltd.:
--------------------------------------------------------------------------------
NAME VERSION FREEDRIVER TYPE
--------------------------------------------------------------------------------
network-r8168 2023.09.12 true PCI
> 0000:08:00.0 (0300:1002:164e) Display controller ATI Technologies Inc:
--------------------------------------------------------------------------------
NAME VERSION FREEDRIVER TYPE
--------------------------------------------------------------------------------
video-hybrid-amd-nvidia-prime 2023.03.23 false PCI
video-linux 2018.05.04 true PCI
video-modesetting 2020.01.13 true PCI
video-vesa 2017.03.12 true PCI
> 0000:01:00.0 (0300:10de:2860) Display controller nVidia Corporation:
--------------------------------------------------------------------------------
NAME VERSION FREEDRIVER TYPE
--------------------------------------------------------------------------------
video-hybrid-amd-nvidia-prime 2023.03.23 false PCI
video-nvidia 2023.03.23 false PCI
video-linux 2018.05.04 true PCI
video-modesetting 2020.01.13 true PCI
video-vesa 2017.03.12 true PCI
Thu Mar 28 18:26:31 2024
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 550.54.14 Driver Version: 550.54.14 CUDA Version: 12.4 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA GeForce RTX 4070 ... Off | 00000000:01:00.0 Off | N/A |
| N/A 56C P0 N/A / 100W | 8MiB / 8188MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 1229 G /usr/lib/Xorg 4MiB |
+-----------------------------------------------------------------------------------------+