So I spent $2 to try out iX11 from http://www.zinger-soft.com/index.html.

iX11 gives you an Xserver on the iphone.
You export DISPLAY=xxx.xxx.xxx.xxx:0 in xterm and run a program in the same xterm and it forwards the display to the iphone.

Doing this i was able to make a simple qtruby program that could pause the Rhythmbox on my netbook.

Problem was, it was slow to register the click in the qtruby program i made to make dbus pause rhythmbox. It's not someting that would be feasable.

I need to test it with a gtk program instead and see if it is faster or a c++/qt program.

Running gedit using this method was more than fast and responsive so I think this could work.