Make sure you're holding the stylus down hard enough. If not, and Maemo Mapper thinks you're tapping on a single location, then it will center on that location. If the single location is on the right side of the screen (during a drag-pan from left to right), then Maemo Mapper will pan right instead of left.