There is the solution to my problem: https://gitlab.freedesktop.org/pulseaudio/pulseaudio/-/commit/460d0c0b79939e4e43f30824bcd6358feb1727f5
So it will require a newer PulseAudio to fix my issue with my Audigy card. (mic input on my motherboard works, just sounds quite bad)