It’s likely that your headphones has a different unpowered position compared to a powered idle one. Remember that the sound usually comes out of an headphone thanks to a magnet moving a membrane, magnet oscillating with input power.
I programmed a SystemD service to play a boot sound just before my DE is started so I can hear my system is booted in case my video card ever dies and you get this all for free!