Can't remove panels

Thanks for the instant reply. I have that option set to “Start with an empty session”.
I find it annoying too).