data requirements

calibration set

Requires a calibration dataset for adjustment

4 techniques
GoalsModelsData TypesDescription
Conformal Prediction
Algorithmic
Architecture/model Agnostic
Requirements/black Box
Any
Conformal prediction provides mathematically guaranteed uncertainty quantification by creating prediction sets that...
Empirical Calibration
Algorithmic
Architecture/model Agnostic
Paradigm/supervised
+2
Any
Empirical calibration adjusts a model's predicted probabilities to match observed frequencies. For example, if events...
Temperature Scaling
Algorithmic
Architecture/neural Networks
Paradigm/discriminative
+3
Any
Temperature scaling adjusts a model's confidence by applying a single parameter (temperature) to its predictions. When a...
Calibration with Equality of Opportunity
Algorithmic
Architecture/model Agnostic
Paradigm/supervised
+2
Any
A post-processing fairness technique that adjusts model predictions to achieve equal true positive rates across...
Rows per page
Page 1 of 1