I have two keyboard layouts set up in the XFCE config, the regular US layout and US/dvorak. The panel keyboard switcher is set to global. The dvorak layout is first in the list and should be the default. But it isn’t, the machine uses the standard layout after login. Additionally, plugging in any USB keyboard device seems to make it reset to the standard layout. This got extra annoying after I got some usb security keys that emulate a keyboard and seem to re-enumerate constantly…
I don’t know much about the configuration settings available with Xfce so please bear with me.
If there is no options to disable automatic profile switching you may be able to create udev rules to ignore when specific devices is attached to the system.
You can view the state of the plugin