What you can do is to regenerate the server keys (after backing up the previous ones if you need to revert back to them):
ssh-keygen -t dsa -f /etc/ssh/ssh_host_dsa_key
ssh-keygen -t rsa -f /etc/ssh/ssh_host_rsa_key
Edit: @jjlin answer is definitely less intrusive