See How to Disable Password Authentication for SSH.

vim /etc/ssh/sshd_config

Then:

ChallengeResponseAuthentication no
PasswordAuthentication no
UsePAM no

Then restart the SSH server:

service sshd restart