I compiled VICE for 770 some time ago, but I don't remember having that much difficulties doing so (Maemo 2.0, Vice 1.20). The gnome gui (use --enable-gnomeui in configure) had only a few gnome function calls which had straightforward gtk equivalents, so it became gtk-only gui. It worked, but was unusably slow (2-5 fps in games), so I just scrapped the whole project. Maybe it runs better in N800.