Unloading kernel module makes no difference to power consumption.

However, if the wireless interface was active at the time of module unloading, power consumption would go down. I just do "ifconfig wlan0 down" if I notice wlan consuming power when I'm not using it. This hasn't happened since February 2010 for me.