Just a suggestion, although one that might be hard to implement since it surely has to do with hildon-desktop.
Instead of moving the desktops, why not just move the widgets when the live wallpaper is active?
That way you can always see the wallpaper without putting a lot of load on the device (be it the CPU or the DSP)