It seems the only difference was that on my laptop I've downloaded the full offline installer and on my PC I used the online installer.
Now that I've also installed the offline installer on my PC it works there as well.

It's a bit strange, but it works so I'm happy.