Well, initial buffering is always needed but if it's slow then maybe o2's network is slow? On my N900 I have to wait three seconds, then it pretty much works flawlessly(Youtube, that is).

EDIT: You could always try http://speedtest.net/ and see what results you get...