What is needed is a quality HW composer library and API, which takes GPU layers together and in a fast way overlays them using a HW part. KMS is still in it's infancy regarding that. When you use HW composer to compose together GPU buffers/layers (which is a production API one in Android drivers), you also need to use gralloc, which then means you also need to use Android libGLES.
It may shock a few to discover that IA-Android doesn't actually use Mesa for Android.