If you set it to portrait it will NOT rotate if you rotate the phone, it will only rotate if you open the keyboard.

However, I do not know if it is possible to keep the phone in portrait mode even after you open the keyboard.