How is it not full screen? The bars on the side are like that. I don't really care about those, those are a result of me leaving it as 800x640, not 800x400.

But it should be fullscreen by default, you can go to the options and go to ext user options and press the fullscreen option.