I was suffering a delay when SSHing to my Debian system. I found SSH session slow to start? It’s the DNS stupid! and solved my problem by editing /etc/ssh/sshd_config and adding:

UseDNS no