thats how "push email" works but if you want to setup with another app or web based then you wont get notification unless you are connected .

if you want notification then just like a PC you need to be connected to the net. other wise you can download your emails and sync when you do get connected. this can be done using nokia messaging or any other app.