@ Mikkov

Yes 100% sure. First I deleted the old config, which included the personal cert file, but it didn't show the cert file in the list of files which it was about to delete (in the "are you sure" dialog)
Then I fed it the new files, which were all in 1 separate folder. Yet it gave some strange error during the test and didn't connect. Manually deleted all of the config related files in the openvpn folder, then tried again. All worked perfectly.
So it's probably a minor issue, since only 1 of the 4 files wasn't deleted, but still.