General
12 techniques
Techniques that govern, record or control the work of building and running an AI system, rather than assess one property of the model.
Browse by subcategory
All techniques
12 techniques
| Goals | Models | Data Types | Description | |||
|---|---|---|---|---|---|---|
| Algorithm Review Boards | Process | Architecture/model Agnostic Requirements/black Box | Any | An algorithm review board, also called an AI ethics board or AI review board, is a standing group from different... | ||
| Red Teaming | Process | Architecture/model Agnostic Requirements/black Box | Any | Red teaming is a structured exercise in which a team deliberately tries to make an AI system fail, so that weaknesses... | ||
| Human-in-the-Loop Safeguards | Process | Architecture/model Agnostic Requirements/black Box | Any | Human-in-the-loop safeguards hold an AI system's output at a checkpoint until a trained person has reviewed it.... | ||
| Confidence Thresholding | Algorithmic | Architecture/model Agnostic Requirements/black Box +1 | Any | Confidence thresholding uses a model score to decide whether a prediction should proceed automatically or receive... | ||
| Runtime Monitoring and Circuit Breakers | Algorithmic | Architecture/model Agnostic Requirements/black Box | Any | Runtime monitoring and circuit breakers observe a deployed AI service and restrict model calls when configured signals... | ||
| Model Cards | Documentation | Architecture/model Agnostic Requirements/black Box | Any | A model card is a short structured document published with a trained model, stating what the model is for and what it... | ||
| Datasheets for Datasets | Documentation | Architecture/model Agnostic Requirements/black Box | Any | A datasheet for a dataset is a short document that accompanies the dataset and answers a set of questions about it, in... | ||
| MLflow Experiment Tracking | Process | Architecture/model Agnostic Requirements/black Box | Any | MLflow Tracking is the part of the open-source MLflow platform that records each run of a machine learning training... | ||
| Data Version Control | Process | Architecture/model Agnostic Requirements/black Box | Any | Data Version Control (DVC) is an open-source tool that records which version of a dataset or model was used at each... | ||
| Human Rights, Democracy and the Rule of Law Risk and Impact Assessment | Process | Architecture/model Agnostic Requirements/black Box | Any | HUDERIA is the Council of Europe's methodology for identifying and assessing the risks an AI system poses to human... | ||
| AI Incident Reporting with the OECD Common Reporting Framework | Documentation | Architecture/model Agnostic Requirements/black Box | Any | AI incident reporting with the OECD common reporting framework records each event in which an AI system caused harm, or... | ||
| SMACTR Internal Algorithmic Audit | Process | Architecture/model Agnostic Requirements/black Box | Any | SMACTR is an internal audit procedure for AI systems, proposed by Raji and colleagues in 2020, in which an audit team... |
Rows per page
Page 1 of 1