Basically the x server and hildon desktop are loaded from init scripts. To load xfce for example, you would just stop hildon desktop and the x server, then start the x server then run xfce4-session. This is more proof of concept than "everyday usable." Glad you're enjoying it.