Make sure you have "Restore previous profile" and "Restore availability" options set. That should restore whatever settings were on those actions before the rule activated. Another thing to note is that on version 1.5.0 you need to have both the Ringing action and Availability action inside the same rule for it to work.