I've tried elipsoid's method of setting the MicroSD's swap file priority higher than the internal flash and it definitely is faster. Also it's better to wear out a replaceable microSD than the non-replaceable internal flash storage.

You can also add those swapoff/swapon commands to a startup script, I've done it and it doesn't seem to affect boot time at all.