SDL was already installed on my N800. Whether that's by default or if it's a dependency for something else I installed, I'm not sure.

Although libSDL was preinstalled in the Maemo VMWare Appliance, so I'm inclined to think it's all included...?