explanatory scope
local
Provides explanations for individual predictions
28 techniques
| Goals | Models | Data Types | Description | |||
|---|---|---|---|---|---|---|
| SHapley Additive exPlanations | Algorithmic | Architecture/model Agnostic Requirements/black Box | Any | SHAP (SHapley Additive exPlanations) explains one prediction by sharing out the gap between that prediction and a... | ||
| Integrated Gradients | Algorithmic | Architecture/neural Networks Architecture/neural Networks/transformer +4 | Image Tabular Text | Integrated Gradients assigns input features scores for a prediction relative to a chosen reference input, called the... | ||
| DeepLIFT | Algorithmic | Requirements/model Internals Architecture/neural Networks +2 | Any | DeepLIFT (Deep Learning Important FeaTures) explains a single prediction of a neural network by dividing the difference... | ||
| Layer-wise Relevance Propagation | Algorithmic | Requirements/model Internals Architecture/neural Networks +3 | Any | Layer-wise Relevance Propagation (LRP) explains a neural network's prediction by working backwards from the output to... | ||
| Contextual Decomposition | Algorithmic | Architecture/neural Networks/recurrent Requirements/white Box +1 | Text | Contextual Decomposition explains why an LSTM, a neural network that reads text one word at a time, made a particular... | ||
| Taylor Decomposition | Algorithmic | Requirements/model Internals Architecture/neural Networks +3 | Any | Taylor Decomposition explains one prediction of a neural network by splitting its output score into a contribution from... | ||
| Local Interpretable Model-Agnostic Explanations | Algorithmic | Architecture/model Agnostic Requirements/black Box | Any | LIME (Local Interpretable Model-agnostic Explanations) explains individual predictions by approximating the complex... | ||
| Individual Conditional Expectation Plots | Visualisation | Architecture/model Agnostic Requirements/black Box | Tabular | Individual Conditional Expectation (ICE) plots display the predicted output for individual instances as a function of a... | ||
| Gradient Saliency | Algorithmic | Architecture/neural Networks Requirements/differentiable +2 | Image | Gradient saliency (also called vanilla gradient saliency) is the simplest gradient-based explanation for image... | ||
| Gradient-weighted Class Activation Mapping | Algorithmic | Architecture/neural Networks/convolutional Requirements/architecture Specific +3 | Image | Grad-CAM (Gradient-weighted Class Activation Mapping) draws a heatmap over an image showing which regions most raise a... | ||
| Occlusion Sensitivity | Algorithmic | Architecture/model Agnostic Requirements/black Box | Image | Occlusion sensitivity shows which parts of an input a model's prediction is sensitive to. A region of the input, such as... | ||
| Attention Weight Analysis | Algorithmic | Architecture/neural Networks/recurrent Architecture/neural Networks/transformer +2 | Image Text | Attention weight analysis reads the weights an attention-based neural network assigns to the parts of its input, to see... | ||
| Influence Functions | Algorithmic | Architecture/linear Models Architecture/neural Networks +5 | Any | Influence functions estimate which training examples most affected a model's prediction on a particular test example.... | ||
| Contrastive Explanation Method | Algorithmic | Architecture/neural Networks Paradigm/discriminative +4 | Any | The Contrastive Explanation Method (CEM) explains one prediction of a classifier, such as a neural network, by... | ||
| ANCHOR | Algorithmic | Architecture/model Agnostic Requirements/black Box | Tabular | ANCHOR explains one prediction of a black-box classifier with an if-then rule, called an anchor, such as 'age > 30 AND... | ||
| Neuron Activation Analysis | Algorithmic | Architecture/neural Networks Requirements/model Internals +1 | Text | Neuron activation analysis examines when individual neurons in a neural network respond strongly. The analyst runs a set... | ||
| Causal Mediation Analysis in Language Models | Algorithmic | Architecture/neural Networks/transformer Architecture/neural Networks/transformer/llm +3 | Text | Causal mediation analysis traces which internal components of a language model carry the effect of a change in the input... | ||
| Concept Activation Vectors | Algorithmic | Architecture/neural Networks Requirements/gradient Access +2 | Any | A concept activation vector (CAV) is a direction inside a neural network that stands for a human idea such as 'stripes'.... | ||
| Chain-of-Thought Faithfulness Evaluation | Testing | Architecture/neural Networks/transformer/llm Paradigm/generative +1 | Text | Chain-of-thought faithfulness evaluation tests whether the step-by-step reasoning a language model writes out is what... | ||
| Explainer Latency Benchmarking | Testing | Architecture/model Agnostic Requirements/black Box | Any | Explainer latency benchmarking measures how long an explanation method takes to produce an explanation for a single... |
Rows per page
Page 1 of 2