Put basically the proposed Swappolube settings make your swap less aggressive an stops the drive righting as much to the slower part of your memory.

Your issue could be swap fragmentation, does a reboot fix it?

Also if you have a slow moment hit Ctrl, Shift + X then when a terminal appears type "top" the top process is using the most CPU.