If they're not running, they don't take cpu time so they don't slow anything down (unless you mean some widgets (or things sleeping on some other bus which is unlikely (or you can prove something actually slows down)))

you can check with 'top' in the terminal what's the most cpu-hungry process.