It turned out that I mixed up my devices (productive vs. testing) and for some reason set up a different ssh password on the testing device which I was now trying to use on the producttive one.

I guess I shouldn't do such things with a new-years hangover.
Thanks anyway!