The solution described in https://stackoverflow.com/a/59170001/211280 works. Not exactly as before, but it works for me. Emacs now ask for the passphrase in the minibuffer. I like this.
Summary:
Add this to ~/.gnupg/gpg.conf:
use-agent
pinentry-mode loopback
and this to ~/.gnupg/gpg-agent.conf
allow-loopback-pinentry
Then restart the agent with echo RELOADAGENT | gpg-connect-agent.
Source of that answer: Fixing GPG "Inappropriate ioctl for device" errors — Daniel15