The purpose of that magnet is to automatically unmount the SD card when the battery cover is removed. It does not prevent the device booting, nor does it force it to shut dovn. Your problem may be with battery contacts or, worse, a headline crack in the PCB.