That GPU is like 15 years old… do you really need the latest LTS kernel on such old hardware? Maybe 6.1 LTS would work better for you.
You can change the boot target to to CLI by
$ sudo systemctl set-default multi-user.target
To revert that
$ sudo systemctl set-default graphical.target