I’m afraid you need to find the offending configuration option. Maybe it’s an application that starts automatically, maybe it’s the KDE display configuration, or maybe it’s something else.
The Xorg configuration I posted should ignore the GTX 1080 altogether. If you delete it, and boot without any display related Xorg configuration files, I believe both should be automatically configured, and you should be able to use both.