I did think about including close application. But it's trickier to implement and might not work for all applications (at least with the approach I was thinking using). As no one requested this during the testing phase, I decided not to pursue it and keep things simple instead.

So you will have to use Custom action and killall processname to achieve closing applications.