In fact the default FAT32 cluster size is 16KB for a 1GB SD card and 32KB for anything larger (up to the 8GB SDHC currently available).
Since FAT32 also has a limit of (approximately) 4 billion clusters, this places a restriction on minimum cluster size that affects larger cards. You can have 512 byte clusters only on volumes up to 2GB. The limit becomes 1KB on a 4GB volume, 2KB on an 8GB volume, and so on.