ssh in to the device and cd to /usr/share/applications/hildon
There find the icon you want to delete and delete it.... for example if you want to delete maemo-mapper.desktop type:

rm maemo-mapper.desktop

and it will remove the icon.