expertise needed
safety engineering
Requires safety engineering principles and practices
11 techniques
| Goals | Models | Data Types | Description | |||
|---|---|---|---|---|---|---|
| Safety Envelope Testing | Testing | Architecture/model Agnostic Requirements/black Box | Any | Safety envelope testing checks how an AI system performs at and beyond the edges of the conditions it was designed for,... | ||
| Runtime Monitoring and Circuit Breakers | Algorithmic | Architecture/model Agnostic Requirements/black Box | Any | Runtime monitoring and circuit breakers observe a deployed AI service and restrict model calls when configured signals... | ||
| Multi-Agent System Testing | Testing | Architecture/model Agnostic Requirements/black Box | Any | Multi-agent system testing examines systems in which several AI agents act on shared tasks or resources, to find... | ||
| Scenario-Based Simulation Testing | Testing | Architecture/model Agnostic Requirements/black Box | Any | Scenario-based simulation testing checks an automated system, most often an automated driving system, by running it... | ||
| Fault Tree Analysis | Process | Architecture/model Agnostic Requirements/black Box | Any | Fault tree analysis (FTA) is a deductive, top-down method that starts from one undesired system-level event, such as an... | ||
| Machine Learning Failure Mode and Effects Analysis | Process | Architecture/model Agnostic Requirements/black Box | Any | Machine Learning Failure Mode and Effects Analysis (ML FMEA) applies the process form of failure mode and effects... | ||
| System-Theoretic Process Analysis | Process | Architecture/model Agnostic Requirements/black Box | Any | System-Theoretic Process Analysis (STPA) is a hazard analysis method developed by Nancy Leveson at MIT that treats... | ||
| Linear Bound Propagation Verification | Algorithmic | Architecture/neural Networks Requirements/white Box | Image Tabular | Linear bound propagation verification proves that a trained neural network meets a stated property for every input in a... | ||
| Signal Temporal Logic Monitoring | Algorithmic | Architecture/model Agnostic Requirements/black Box | Time-series | Signal temporal logic (STL) monitoring checks the signals a system produces over time, such as speeds, distances,... | ||
| SMT-Based Neural Network Verification | Algorithmic | Architecture/neural Networks Architecture/neural Networks/feedforward +1 | Tabular | SMT-based neural network verification decides exactly whether any input in a defined region can make a trained neural... | ||
| SMACTR Internal Algorithmic Audit | Process | Architecture/model Agnostic Requirements/black Box | Any | SMACTR is an internal audit procedure for AI systems, proposed by Raji and colleagues in 2020, in which an audit team... |
Rows per page
Page 1 of 1