Yes, USB Host iss the Problem. :-(

But I think Zeemote could be possible. :-)
Here a Picture for thome who dosn't know of this (cheap but preety good) device:


It has a litte Joystick and 4 Buttons. (one iss double used and also the power Switch)