Thanks to the suggestion from @lare I found the cause of all of this. In the file /etc/mkinitcpio.conf the HOOK encrypted vanished after the update. I now added it again and even installed the newer kernel 6.1 and it works with all installed kernels (5.15, 6.0 and 6.1)