To be able to use USB debugging you need to add yourself to adbusers group
sudo gpasswd -a $USER adbusers