It's because your hand is casting an intermittent shadow on the ambient light sensor, and it's trying to compensate. But there's a time delay of a few seconds, so it's not obvious what's going on.

I wish there was a way to turn off this behaviour. I would be quite happy to change the brightness myself when I'm working in a dark place. It's only two clicks to adjust the screen brightness.

Regards,
Roger