In that case, vim will be in /usr/bin/vim. It's a bit hacky as uninstallation becomes a matter of finding all the files in the deb and removing them.

There's also the possibility of overwriting something core to the OS, and having to reflash your device.

Of course, 2006 OS' better package management will remove all these problems by installing everything under /.