Not that this is a solution or anything but in case anyone else is following I should note that I found the following bug which seems to be exactly my problem:

https://bugs.maemo.org/show_bug.cgi?id=6173