I have read the original poster’s post a few times and it still is not clear to me. Is xfce and gnome installed on the same computer? Does it work okay with another LTS kernel e.g 5.15 or 6.2, 6.3?
Can you post a full inxi output? How about posting journal output?
Dual-booting? Is this installed or in a VM? There isn’t enough here to begin to guess what the issue is.