I don't see an option to downgrade NVIDIA drivers

No - there is no way.