Thanks for the info! If I want to use my own config inside dpkg-buildpackage, where should I specify that?
DEFCONFIG := rm581_defconfig
DEB_BUILD_OPTIONS=parallel=10 dpkg-buildpackage -rfakeroot