Getting Started
Measure predictions uncertainty
Control prediction errors
Calibrate classifiers
Exchangeability Testing
Question & Answers
API
mapie.regression
mapie.metrics.regression
mapie.conformity_scores
mapie.subsample
mapie.classification
mapie.metrics.classification
mapie.risk_control
MultiLabelClassificationController
mapie.risk_control.MultiLabelClassificationController
BinaryClassificationController
mapie.risk_control.BinaryClassificationController
SemanticSegmentationController
mapie.risk_control.SemanticSegmentationController
BinaryRisk
mapie.risk_control.BinaryRisk
BinaryClassificationRisk
mapie.calibration
mapie.metrics.calibration
mapie.utils
train_conformalize_test_split()
mapie.utils.train_conformalize_test_split
The following examples introduce MAPIE exchangeability testing on a fixed dataset and on an online stream.
Exchangeability testing on an online stream
Exchangeability testing on a fixed dataset
Detect harmful shifts with RiskMonitoring
