On a windows PC, you can run X applications from a remote X based machine.
On that windows PC, you will need: an X server (bit confusing, because you are more like a client) like Xming and a terminal program like putty with x forwarding enabled.

If it is resolution wise possible, you can also take over a desktop just using VNC. Somewhat easier to configure and you can also control windows remote.

Good luck experimenting