Because whatever you modify via nvidia-settings has to be added to /etc/X11/mhwd.d/nvidia.conf file and NOT create the /etc/X11/xorg.conf because those two will be in conflict, creating the issue you described.
On the other hand, the OP has:
But the Nvidia driver might have some issues