Linux is not Windows: latest kernel is not always best. 5.4 is a robust LTS release and if it works, use that. Only when you like to experiment and file bugs and help other (less advanced) users downstream or have very new hardware, should you be running experimental kernels.
5.10 has very recently become an LTS so it’s not as solid as 5.4, so I have both installed and normally run 5.10 until something breaks and then I file a bug and boot into 5.4 until a new release comes out and then I switch back to 5.10.
If you want more of these little bits of wisdom, please read this: