I needed to run

  $ sudo locale-gen en_AU.UTF-8

to fix a problem I was having with my locale settings. I found out about that over here.