Trying to connect to SSH add-on from another linux Permission denied (publickey)

Hi there

I have the ssh community add-on installed on ha, and I can connect to it fine from putty.
I’ve added the pub key from a linux server to it, but when I try top connect to HA from that one with
ssh [email protected] I get the messager Permission denied.
locally on the linux (ubuntu 18.04) the keys were generated with a simple ssh-keygen, and it’s created as it should under .ssh, and have the correct rights.
I did a ssh-copyid to another linux from the ubuntu, and I can connect fine to that server.
I couldn’t do a ssh-copyid to the ssh addon of couse, so instead I just pasted it in below the other ssh pub keys.
So what am I doing wrong?