Jolla's camera app does not rotate the pictures, it just adds exif orientation tag to them. If you view the images with some software which does not support exif orientation tag the images will appear in wrong orientation.

Edit: and actually there's a bug too https://together.jolla.com/question/...-in-exif-data/