Why Ubuntu Mobile, exactly? It's mostly about GUI, none of which you will be using for a server.

Personally, I'd just pick up a Beagle or overo and drop it into a small homemade case, then put Ubuntu or Debian (hell, maybe Ångstrom) on it and call it a day. Cheap, small, expandable.