As I understand it, the only built-in app that can use portrait mode is the phone app. (And possibly the image browser app?)