Thank You for your Answer! 
I had disabled the Bluetooth sleep already but the problem still was there.
I experimented with some different kernel versions, and on 5.14.rc6, the problem seems to have disappeared.
Anyway I installed tlpui anyhow, I did not know about that and it seems to be very useful.