It should only be doing this, if the screen is on. If you leave the conversation window open and the screen either times out or you lock the device, regular notification should happen.