If you click on the battery icon, you will see the orientation lock option. Use it to enable the portrait mode. You will know that it works if you see that you enabled the portrait desktop. Btw the portrait mode won't work with the calculator app because it is black listed.