Well, I don't think the comparison with n800 is fair, what we have here is not thumb, but thumb2. Which is a totally different beast.
There is no performance hit because of ISA switching, as there is no ISA switching .
BTW I thumb2 compiled microb, and the difference in code size is about 7-8 MiB, which is a HUGE difference