This is essentially what was demonstrated in NRC's prototype they have shown in the Linked UI concept: http://research.nokia.com/research/linkedui