It will not bother. But take it this way. I use power saving for my screen so every minute the screen automatically turns off it and most of the time I lock the screen.

So if you count, out of 24 hours my screen usage is only for 1 - 1.5 hours. Still rducing the brightness to 2-3 level will make such a huge difference?