applicable models
transformer
Techniques for transformer-based architectures
5 techniques
| Goals | Models | Data Types | Description | |||
|---|---|---|---|---|---|---|
| Integrated Gradients | Algorithmic | Architecture/neural Networks Architecture/neural Networks/transformer +4 | Image Tabular Text | Integrated Gradients assigns input features scores for a prediction relative to a chosen reference input, called the... | ||
| Attention Weight Analysis | Algorithmic | Architecture/neural Networks/recurrent Architecture/neural Networks/transformer +2 | Image Text | Attention weight analysis reads the weights an attention-based neural network assigns to the parts of its input, to see... | ||
| Causal Mediation Analysis in Language Models | Algorithmic | Architecture/neural Networks/transformer Architecture/neural Networks/transformer/llm +3 | Text | Causal mediation analysis traces which internal components of a language model carry the effect of a change in the input... | ||
| Embedding Bias Analysis | Testing | Architecture/neural Networks Architecture/neural Networks/transformer +3 | Text Image | Embedding bias analysis tests whether the numerical representations a model uses for words, images or documents link... | ||
| Sparse Autoencoder Feature Analysis | Algorithmic | Architecture/neural Networks/transformer Architecture/neural Networks/transformer/llm +2 | Text | Sparse autoencoder feature analysis looks for human-interpretable units inside a neural network, usually a language... |
Rows per page
Page 1 of 1