Yes, it should work that way. If your app is opened it assumes you are engaged in a conversation so there is no loud notification. This change was in response to feedback by other users.