That is obviously a misconception. It is almost like you want your users to eat food but do not want them to prepare it. This may work for iPhone, with its iTunes store and an audience of users willing to put up with whatever Apple inflicts on them. This is not going to work for Maemo, starting with the fact that Nokia does not provide anything comparable to iTunes in functionality and ending with the Maemo user base not willing to put up with the lack of control of their data. This means that users will manage their own media files and you have to address this activity properly.
Ok, not talking about specialized gaming devices here. But let us take pretty modest games available on Nokia devices via NGage. A lot of them (if not most) require directional controls and OpenGL ES APIs to be usable. I hope we both agree that having at least this kind of games play is well within the intended use for Maemo?