Ok, I finally found it. It was actually a setting for the account, you can set different signatures for different accounts you have set up.