Well if you lock one thing in memory, everything else suffers... Also, I imagine getting X to sensibly ensure that it's able to always service certain apps is going to be a gigantic effort to program..