In real life, I can guarantee you that there is no visible difference to the quality of the video by downscaling.
I guess you don't watch a lot of videos on your phone.