Ok, so your copy program is causing "swapping hell" by poisoning page cache and pushing all processes to swap. Do copies with the file manager or gnome-vfs (which has been fixed to tell kernel that that all the data it's copying doesn't need to be cached) instead of cp / dd.