The problem there is you made it too simple, lemme try to squiggle out a drawing of what i mean: Your example there is more of a job for the multiple buttons on each side algo; either way, you forget about the time dimension, at any given moment you always know at least one side for sure because of where the cursor moved to before.