First thought is that you may have a file permission issue on the target -- possibly selinux contexts. Have a look in /var/log/secure on the target server and it will tell you what the culprit is.
I tend to use ssh-copy-id because this always ensures you've got your permissions right.
Kal