Binary Classification Inspector - can I use flow variables to define different custom thresholds for different models?

Hello everyone,

My current task is to implement two separate workflows for a blind validation of several models. I would train several models (Gradient Boosted Trees, Random Forest, etc.) with Workflow 1 on a large dataset, and cache the models on the disk. My colleague would then read the saved models with Workflow 2, and validate them on a different dataset.

I saved the binary classification threshold optimised on the training set, as calculated by the BinaryClf inspector in Workflow 1. I would like to overwrite the thresholds in Workflow 2 with these, but I’m not sure how.

image

There seems to be a flow variable option (inViewThresholdValues) in the BinaryClf inspector dialogue box where I can define different thresholds for different models:

And I imagine this must be the expected format for the said flow variables:

However, defining this flow variable doesn’t seem to have any effect. It seems I can only define one uniform custom threshold for all models in the “Initial threshold methods” box shown here: (This is clearly suboptimal for me)

Hello @qzhang1,

Are you able to post a workflow of this so we can better help you?

TL

2 Likes

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.