Swap used after powering up is caching. Linux swap doesn't work like Windows swap which is only used when memory gets full. Using swap for cache can help increase responsiveness. The sluggishness begins when some memory pages of active applications get swapped out. But when this happens you know that you wouldn't have got that far without swap space.