If you want KDE to remember your SSH key’s passphrase for your whole desktop session you can create a ~/.config/autostart/ssh-add.desktop file like this:
[Desktop Entry] Type=Application Name=ssh-add Comment=Adds my private key to my session. Exec=/usr/bin/konsole -e 'ssh-add /home/$USER/.ssh/id_rsa'