The brightness slider in test binary was accidentally set to process motion every 10µs but I've since changed it to 100ms. Not much of a difference though.

Changing the X polling from 250ms to 100ms would probably just waste cpu cycles since the button release event can take longer than 250ms to become available.