I haven't had a single hang-up on the desktop with slide2answer. The thing that hangs sometimes with slide2answer is hildon-status-menu (the menu that comes up when clicking on the clock or the battery icon). And if I understand the OP correct, it's the icons on the desktop that isn't working for him. /oxpo
sr00t, to find out what causing this issue remove one by one widget for a few days. I had the same problem and after I removed maxcpu widget it disappeared. I'm not saying that maxcpu is the one which is responsible for problem, maybe it's some other widget which is in conflict with maxcpu. Because maxcpu is not essential for me, I decided to permanently remove it and to stop checking other widgets. Based on my experience, I recommend you to start with maxcpu. Remove it and then reboot the phone and use it for a few days. If the problem occurs again, try to remove another widget and so on, until you don't find the right trouble maker.