did you try to add an Ee preset for pipewire rather than removing everything?
(there are a couple of threads in the tutorials section like: [HowTo] Enhance your Linux audio with EasyEffects or PulseEffects Legacy this one with some presets linked.
I havent had the same issue but i never used Ee when i had pulseaudio. i found pipewire quieter and Ee had a “boost” profile which has worked well.
Other than that i can cant suggest anything, sorry.