The only issue I really have with the standard hildon-home is that it consumes about 5% cpu, it's otherwise very stable.

If you are using the modified version that provides you with up to 9 separate views, then that will probably be the culprit - it was for me anyway, same symptoms you described. Went away when I installed the faster scrolling version.