Cutoff threshold for binary classifier models

In this article I have a sample workflow with a Metanode that would try to find an optimal cut-off point using two metrics. H2O nodes would find their best cutoff.

In general a cut-off would very much depend on you business question and often your costs associated with making a wrong prediction.