You have to specifically choose where you store data.

The default location is normally internal flash (i.e. not on an SD card at all). Some apps may have chosen to store data on one or other card, which would explain you having any data on them at all.