Microsoft flirted with this years ago-- Windows Media Center edition came with little lifelike avatars that could move according to what was going on at the time (I know music was an input but I think there may have been others).