expertise needed
governance and audit
Requires organisational governance and audit practice: running review or oversight processes, keeping accountable records, and writing documentation that an auditor or regulator relies on.
11 techniques
| Goals | Models | Data Types | Description | |||
|---|---|---|---|---|---|---|
| Algorithm Review Boards | Process | Architecture/model Agnostic Requirements/black Box | Any | An algorithm review board, also called an AI ethics board or AI review board, is a standing group from different... | ||
| Red Teaming | Process | Architecture/model Agnostic Requirements/black Box | Any | Red teaming is a structured exercise in which a team deliberately tries to make an AI system fail, so that weaknesses... | ||
| Human-in-the-Loop Safeguards | Process | Architecture/model Agnostic Requirements/black Box | Any | Human-in-the-loop safeguards hold an AI system's output at a checkpoint until a trained person has reviewed it.... | ||
| Model Cards | Documentation | Architecture/model Agnostic Requirements/black Box | Any | A model card is a short structured document published with a trained model, stating what the model is for and what it... | ||
| Datasheets for Datasets | Documentation | Architecture/model Agnostic Requirements/black Box | Any | A datasheet for a dataset is a short document that accompanies the dataset and answers a set of questions about it, in... | ||
| CycloneDX Machine Learning Bill of Materials | Documentation | Architecture/model Agnostic Requirements/black Box | Any | A CycloneDX ML-BOM (machine-learning bill of materials) is a machine-readable inventory of what a model is made of,... | ||
| Human Rights, Democracy and the Rule of Law Risk and Impact Assessment | Process | Architecture/model Agnostic Requirements/black Box | Any | HUDERIA is the Council of Europe's methodology for identifying and assessing the risks an AI system poses to human... | ||
| AI Incident Reporting with the OECD Common Reporting Framework | Documentation | Architecture/model Agnostic Requirements/black Box | Any | AI incident reporting with the OECD common reporting framework records each event in which an AI system caused harm, or... | ||
| SMACTR Internal Algorithmic Audit | Process | Architecture/model Agnostic Requirements/black Box | Any | SMACTR is an internal audit procedure for AI systems, proposed by Raji and colleagues in 2020, in which an audit team... | ||
| AI FactSheets | Documentation | Architecture/model Agnostic Requirements/black Box | Any | AI FactSheets is a documentation practice in which the developer or supplier of an AI model or service answers a... | ||
| UK Algorithmic Transparency Recording Standard Record | Documentation | Architecture/model Agnostic Requirements/black Box | Any | An Algorithmic Transparency Recording Standard (ATRS) record is a public account that a UK public sector organisation... |
Rows per page
Page 1 of 1