Custom kernel can't break the device, worst case scenario is that you have to reflash the kernel with another one cause you didn't rebuild the modules.