Ah well you use pulseaudio. There is a file called default.pa in /etc/pulse/. Copy it to ~/.config/pulse/ and edit it. Remove the line with load-module module-suspend-on-idle or comment it by putting a # in front of it. Then restart it:
systemctl --user restart pulseaudio.service
If that does not work, then no idea.