Since Maemo can multi-task, you could always leave the File Manager open. I personally, have it as one of my Personal Launcher apps (as mentioned). At least you're only a couple clicks away at that point.

Tim