I had the same issue and think I found a way to fix it. I had two accounts on the phone. One is a gmail account and the other is an Exchange account. I removed both accounts and added them back in. Now the e-mail is lightening fast. I hope that works for you as well.