expertise needed
software engineering
Requires general programming and system design skills
12 techniques
| Goals | Models | Data Types | Description | |||
|---|---|---|---|---|---|---|
| Federated Learning | Algorithmic | Architecture/linear Models Architecture/neural Networks +4 | Any | Federated learning trains one shared model across several parties, such as phones or hospitals, without collecting their... | ||
| Runtime Monitoring and Circuit Breakers | Algorithmic | Architecture/model Agnostic Requirements/black Box | Any | Runtime monitoring and circuit breakers observe a deployed AI service and restrict model calls when configured signals... | ||
| MLflow Experiment Tracking | Process | Architecture/model Agnostic Requirements/black Box | Any | MLflow Tracking is the part of the open-source MLflow platform that records each run of a machine learning training... | ||
| Data Version Control | Process | Architecture/model Agnostic Requirements/black Box | Any | Data Version Control (DVC) is an open-source tool that records which version of a dataset or model was used at each... | ||
| API Usage Pattern Monitoring | Algorithmic | Architecture/model Agnostic Requirements/black Box | Any | API usage pattern monitoring examines how each account uses a deployed model's API, to catch misuse that no single... | ||
| Model Extraction Defence Testing | Testing | Architecture/model Agnostic Requirements/black Box | Any | Model extraction defence testing checks whether a model offered through a query interface, such as a prediction API, can... | ||
| Multi-Agent System Testing | Testing | Architecture/model Agnostic Requirements/black Box | Any | Multi-agent system testing examines systems in which several AI agents act on shared tasks or resources, to find... | ||
| Model Signing | Algorithmic | Architecture/model Agnostic Requirements/white Box | Any | Model signing lets the publisher of a machine-learning model attach a cryptographic signature to the model's files, so... | ||
| Signal Temporal Logic Monitoring | Algorithmic | Architecture/model Agnostic Requirements/black Box | Time-series | Signal temporal logic (STL) monitoring checks the signals a system produces over time, such as speeds, distances,... | ||
| Metamorphic Testing | Testing | Architecture/model Agnostic Requirements/black Box | Any | Metamorphic testing checks a model or AI system without needing the correct output for each test input, by checking that... | ||
| Explainer Latency Benchmarking | Testing | Architecture/model Agnostic Requirements/black Box | Any | Explainer latency benchmarking measures how long an explanation method takes to produce an explanation for a single... | ||
| C2PA Content Credentials | Algorithmic | Architecture/model Agnostic Paradigm/generative +1 | Image Text | C2PA Content Credentials attach a signed provenance record, called a manifest, to a media file, so that whoever receives... |
Rows per page
Page 1 of 1