The light sensor always calibrates the screen brightness, but with a little delay.

If you keep your device in your pocket, or in a darker place, it is normal that the screen brightness will increase by time.