Ok, after playing with the Display settings, like changing the "Backlight time-out" and "Lock screen automatically", this problem went away.

Weird, but worked.