Explainability
Fidelity
Accurately represents true model behaviour
20 techniques in this subcategory
20 techniques
| Goals | Models | Data Types | Description | |||
|---|---|---|---|---|---|---|
| Permutation Importance | Algorithmic | Architecture/model Agnostic Requirements/black Box | Tabular | Permutation Importance measures how much a trained model relies on each input feature. For each feature, the values in a... | ||
| Coefficient Magnitudes (in Linear Models) | Metric | Architecture/linear Models Paradigm/parametric +2 | Tabular | Coefficient Magnitudes explains a linear model by reading its fitted coefficients. Each coefficient shows how much the... | ||
| Layer-wise Relevance Propagation | Algorithmic | Requirements/model Internals Architecture/neural Networks +3 | Any | Layer-wise Relevance Propagation (LRP) explains a neural network's prediction by working backwards from the output to... | ||
| Contextual Decomposition | Algorithmic | Architecture/neural Networks/recurrent Requirements/white Box +1 | Text | Contextual Decomposition explains why an LSTM, a neural network that reads text one word at a time, made a particular... | ||
| Taylor Decomposition | Algorithmic | Requirements/model Internals Architecture/neural Networks +3 | Any | Taylor Decomposition explains one prediction of a neural network by splitting its output score into a contribution from... | ||
| Local Interpretable Model-Agnostic Explanations | Algorithmic | Architecture/model Agnostic Requirements/black Box | Any | LIME (Local Interpretable Model-agnostic Explanations) explains individual predictions by approximating the complex... | ||
| Ridge Regression Surrogates | Algorithmic | Architecture/model Agnostic Requirements/black Box | Tabular | A ridge regression surrogate approximates a complex model with a linear equation fitted to the complex model's own... | ||
| Partial Dependence Plots | Visualisation | Architecture/model Agnostic Requirements/black Box | Tabular | Partial Dependence Plots show how changing one or two features affects a model's predictions on average. The technique... | ||
| Individual Conditional Expectation Plots | Visualisation | Architecture/model Agnostic Requirements/black Box | Tabular | Individual Conditional Expectation (ICE) plots display the predicted output for individual instances as a function of a... | ||
| UMAP | Algorithmic | Architecture/model Agnostic Requirements/black Box | Any | UMAP (Uniform Manifold Approximation and Projection) is a non-linear dimensionality reduction method that turns... | ||
| Influence Functions | Algorithmic | Architecture/linear Models Architecture/neural Networks +5 | Any | Influence functions estimate which training examples most affected a model's prediction on a particular test example.... | ||
| ANCHOR | Algorithmic | Architecture/model Agnostic Requirements/black Box | Tabular | ANCHOR explains one prediction of a black-box classifier with an if-then rule, called an anchor, such as 'age > 30 AND... | ||
| RuleFit | Algorithmic | Architecture/model Agnostic Paradigm/supervised +1 | Tabular | RuleFit builds a predictive model that a person can read: a short list of if-then rules plus a few ordinary feature... | ||
| Permutation Tests | Algorithmic | Architecture/model Agnostic Requirements/black Box | Any | A permutation test asks how likely an observed result would be if there were no real relationship in the data. The... | ||
| Generalized Additive Models | Algorithmic | Architecture/linear Models/gam Paradigm/parametric +2 | Tabular | A generalised additive model (GAM) builds its prediction by adding a baseline and one smooth curve for each input... | ||
| Causal Mediation Analysis in Language Models | Algorithmic | Architecture/neural Networks/transformer Architecture/neural Networks/transformer/llm +3 | Text | Causal mediation analysis traces which internal components of a language model carry the effect of a change in the input... | ||
| Chain-of-Thought Faithfulness Evaluation | Testing | Architecture/neural Networks/transformer/llm Paradigm/generative +1 | Text | Chain-of-thought faithfulness evaluation tests whether the step-by-step reasoning a language model writes out is what... | ||
| Deletion and Insertion Curves | Testing | Architecture/model Agnostic Requirements/black Box | Image Text Time-series | Deletion and insertion curves test whether a feature-attribution explanation, such as a heatmap over an image or... | ||
| Explanation Infidelity | Metric | Architecture/model Agnostic Requirements/black Box | Image Tabular | Explanation infidelity scores a feature-attribution explanation (one importance score per input feature) by how well it... | ||
| Sanity Checks for Saliency Maps | Testing | Architecture/neural Networks Requirements/white Box +1 | Image Tabular Time-series | Sanity checks for saliency maps are two randomisation tests that show whether an explanation method's output depends on... |
Rows per page
Page 1 of 1