Hey everyone. I am currently using the extension H2O for some AutoML-Tasks. When trying to evaluate the model performance with the H2O numeric scorer node, I started wondering about the used metrics. In particular I can’t find an in-depth documentation of the used formulas. For example R² could also be an adjusted R² - or some R² can only get to 0, while others can be negative. But there is no documentation about what specific R² is used. Is there any documentation about this and the other metrics? I also noticed that the Python-Based H2O allows for much more indepth analysis. Is there a way to export my model and predictions and then use them in python code to manually assert more/other metrics? Thanks in advance - I am new to ML and Python, so please excuse if some of the awnsers are obvious.

H2O AutoML Numeric Scorer and evaluation in python

mlauber71 October 2, 2024, 8:36pm 2

You can export your H2O model as mojo file and then extract more information via a Python node:

1 Like