I guess this error is the problem and refer to the power saving feature.
I found this here:
1. Turn off APST (nvme_core.default_ps_max_latency_us=0)
2. Turn off APSM (pcie_aspm=off)
3. Turn off both
So add
nvme_core.default_ps_max_latency_us=0 pcie_aspm=off
to the kernel parameter.
One of them or both should solve the issue.