Actually Xournal remembers those settings.
Indeed, there's a bug on the saved color, but the defaults are saved.

What I did:

Change tickness of the pen, set it as default and then save prefs.
Reloading Xournal restored my new default pen tickness.