Tree Ensemble Predictor (Regression) Latency

@gmoran I think the way you set it up will cause the Reader to always re-read the model. You could try to force the placement outside the loop and make sure the model is being cached in memory. You will not be able to avoid the setup within the Predictor since this is what this will do.

And you might want to check why you would have to loop over a set of data when it is present at the same time.

2 Likes