Hah, some further info --- if I have actman running, but set my availability for my IM accounts to "offline", the problem also goes away. So it appears the problem is some kind of interaction between the two.