remove the image(s) in /home/user/.wallpapers and reboot.
It is funny that you can set a wallpaper in the settings
application, but there is no option to unset this setting.