Explainability
Attention Patterns
Displays attention mechanisms in models (e.g., Attention Visualization in Transformers)
2 techniques in this subcategory
2 techniques
| Goals | Models | Data Types | Description | |||
|---|---|---|---|---|---|---|
| Classical Attention Analysis in Neural Networks | Algorithmic | Architecture/neural Networks/recurrent Requirements/architecture Specific +1 | Any | Classical attention mechanisms in RNNs and CNNs create alignment matrices and temporal attention patterns that show how... | ||
| Attention Visualisation in Transformers | Algorithmic | Architecture/neural Networks/transformer Requirements/architecture Specific +1 | Image Text | Attention Visualisation in Transformers analyses the multi-head self-attention mechanisms that enable transformers to... |
Rows per page
Page 1 of 1