I developed a workflow for a binary classification model, and I would like to create a table that provides confusion matrix calculations at different threshold values: Table 1 sorts the predicted probabilities in descending order and shows the ground truth next to the probability (this part is easy). something like this: Row Truth Probability 1 1 0.995 2 1 0.991 3 1 0.875 4 0 0.811 5 1 0.73 6 1 0.71 7 0 0.649 8 1 0.602 9 0 0.577 10 0 0.522 Based on Table 1, Table 2 then counts the number of TP, FP, TN, FN at different threshold values ranging from 1 to 0: Cutoff TP FP TN FN 1.0 0 0 3 7 0.9 2 0 3 5 0.8 3 1 3 3 0.7 5 1 3 1 0.6 6 2 2 0 0.5 6 4 0 0 0.4 6 4 0 0 0.3 6 4 0 0 0.2 6 4 0 0 0.1 6 4 0 0 0 6 4 0 0 Any help would be greatly appreciated.

[image] mlauber71: Next idea could be to use the “ Binary Classification Inspector ” with a loop and run thru thresholds from 0.1 to 1.0 It could be something like this: [image] [image] Inspect Results of Machine Learning "BINARY" (0,1) Targets using the "Binary... Inspect Results of Machine Learning "BINARY" (0,1) Targets using the "Binary Classification Inspector" and "H2O Binomial Scorer" https://forum.knime.com/t/crea…

Create a table that counts TP, FP, TN, FN at different thresholds

KNIME Analytics Platform

mlauber71 April 24, 2023, 8:37am 3

@saddas I have created something similar with the help of R in a Metanode:

And also the H2O Binomial Scorer – KNIME Community Hub has a table “Gains lift” to present several thresholds to check.

Next idea could be to use the “Binary Classification Inspector” with a loop and run thru thresholds from 0.1 to 1.0

2 Likes

How to find the confusion matrix of H2O AutoML character type variables?