I have this issue too. It most certainly need the device to be locked for a good while, and it sometimes works.

I have been having the behaviour with MicroB, when it's not in full-screen mode. When I then click the application changer icon, it opens the menu instead! Also on desktop it sometimes opens the menu instead of the intended application switcher/menu action.

Anyone else affected? Is there a bug report yet?