It's not clear cut. In my opinion, this would be a completely unexpected behaviour. Just like when the OMWeather window vanishes when you tap the "Update" button - plain weird and quite scary at first (you think you've done something wrong).

What would be good though would be to allow third party applications to customize this behaviour. Users who want to have the window close automatically could then choose to have it.