It would help if you said which exactly program/process is using the 40-60% of CPU... run "top" from a terminal and it'll show you each process and how much CPU it is using individually.

typically, when nothing is happening you should have basically 0% overall CPU usage.

If you have compositing (3D desktop) enabled that's probably a prime candidate if your top CPU user is X.