Following the creation logic, maybe removing all apps from inside deletes the folder? Didn't try it, though.

Edit: Yes, as soon as there is only one app inside the folder, it gets deleted.