that's about normal for xorg if you run a handful of widgets... try disabling widgets a bit at the time - rule out things you have running to see what is chewing up that RAM. And, yes, io/cache pressure settings in /etc/init.d/rcS will be most helpful, especially if your device is swapping out.