Nope, on the contrary performance will improve because it is much faster to compress and write the compressed data to memory, than it is to write data to a swap on SD card.