What bothers me more than root access is the fact that any 3rd-party app can access all my data easily, as mentioned earlier by erendorn.
Like Angry Birds accessing my address book and sending it elsewhere, for example. That's where action is needed.