Now that you mention it, there were some issues while receiving it, as I was connected to the wifi at that time, and apparently it didn't like the connection.
So I disconnected wifi and connected to the operator's MMS data profile, after which the MMS download started without any complaints.
Is it possible the MMS was not downloaded fully? Is there any way to re-download it somehow?