Anyone having trouble might try uninstall, remove the config files, reboot and reinstall. The folders to delete are:
/var/lib/gconf/apps/Maemo/tomch.com/recaller
/var/lib/gconf/apps/osso/hildon-desktop/applets/recaller.desktop-0

The recreated config files seem to have the same settings as before, but it works now. Perhaps deleting them causes some extra initialisation?