I fixed it! (Sorry I'm such a n00b!)

I didn't realize there was a difference between holding down the power button and hitting it once then clicking "Switch Off" - I thought these did the same thing, but apparently not.

Aka I have screen rotation now!