Transparency
Decision Reasons
Techniques that give people outside the build team the reasons, rules or sources behind a model's outputs, so they can check them.
8 techniques
8 techniques
| Goals | Models | Data Types | Description | |||
|---|---|---|---|---|---|---|
| DeepLIFT | Algorithmic | Requirements/model Internals Architecture/neural Networks +2 | Any | DeepLIFT (Deep Learning Important FeaTures) explains a single prediction of a neural network by dividing the difference... | ||
| Layer-wise Relevance Propagation | Algorithmic | Requirements/model Internals Architecture/neural Networks +3 | Any | Layer-wise Relevance Propagation (LRP) explains a neural network's prediction by working backwards from the output to... | ||
| Contextual Decomposition | Algorithmic | Architecture/neural Networks/recurrent Requirements/white Box +1 | Text | Contextual Decomposition explains why an LSTM, a neural network that reads text one word at a time, made a particular... | ||
| Local Interpretable Model-Agnostic Explanations | Algorithmic | Architecture/model Agnostic Requirements/black Box | Any | LIME (Local Interpretable Model-agnostic Explanations) explains individual predictions by approximating the complex... | ||
| Ridge Regression Surrogates | Algorithmic | Architecture/model Agnostic Requirements/black Box | Tabular | A ridge regression surrogate approximates a complex model with a linear equation fitted to the complex model's own... | ||
| ANCHOR | Algorithmic | Architecture/model Agnostic Requirements/black Box | Tabular | ANCHOR explains one prediction of a black-box classifier with an if-then rule, called an anchor, such as 'age > 30 AND... | ||
| Concept Activation Vectors | Algorithmic | Architecture/neural Networks Requirements/gradient Access +2 | Any | A concept activation vector (CAV) is a direction inside a neural network that stands for a human idea such as 'stripes'.... | ||
| Forward Simulation Test | Testing | Architecture/model Agnostic Requirements/black Box | Any | A forward simulation test checks whether people who have studied a model's explanations can predict the model's output... |
Rows per page
Page 1 of 1