SHAP and Shapley Values Example

KCH Workflows
1

This worflow shows how to use SHAP and Shapley Values Loop nodes and it creates Stacked Bar Charts similar to Force Plots for you to compare and understand the explanations. Disclaimer: color scale is hardcoded on the single explanation. OTHER: SHAP (SHapley Additive exPlanations) - Python Library on GitHub https://github.com/slundberg/shap#citations PAPER: Explaining prediction models and individual predictions with feature contributions, Štrumbelj and Kononenko, 2014 https://link.springer.com/article/10.1007/s10115-013-0679-x

This is a companion discussion topic for the original entry at https://kni.me/w/lOTFT_OHrVaWoV4P
2

This is the view of the final Component generated to compare 2 explanations: one made with SHAP the other one with Shapley Values Loop nodes.

They are almost identical even though the algorithms are quite different.

Capture
Capture938×426 18.2 KB

We are using the titanic dataset explaining why this particular person survived.

Her name was Vestrom, Miss. Hulda Amanda Adolfina

The model gives 66% of probability she survived the sinking of the Titanic, when she actually did not survive.

Most of the mistake of this Random Forest model is due to the fact this person was young (only 14) and female as you can see from the explanation (blue bars). Despite this she also embarked in 3rd class (red bar).

3

The SHAP Summarizer Component fails in my workflow. What could be the reason for that? The error is

Unknown variable: "currentColumnName"

and inside the component a joiner fails and tells me it created an empty data table.

Thanks for your help.