Periodic clicking while playing Media

While playing audio, there is an periodic clicking noise every second that seems to scale with the amplitude of the playback. This only appears on my primary sounddevice, an scarlet 8i6 3rd gen.
I tried to use a different kind of scheduling for pulse and also set all the settings according to my soundcards specifications. Otherwise the sound is consistent and recording sound is working. Is this a problem of the driver and can I do something about it or should I replace my soundcard?