All exchangeability testing examples

Following is a collection of examples demonstrating how to use MAPIE for exchangeability testing.

1. Quickstart

The following examples introduce MAPIE exchangeability testing on a fixed dataset and on an online stream.

Exchangeability testing on an online stream

Exchangeability testing on an online stream

Exchangeability testing on a fixed dataset

Exchangeability testing on a fixed dataset

Detect harmful shifts with RiskMonitoring

Detect harmful shifts with RiskMonitoring

2. Advanced analysis

The following examples use MAPIE for discussing more complex exchangeability testing problems.

Permutation test with a fitted classifier

Permutation test with a fitted classifier

Online martingale exchangeability tests for a deployed regressor

Online martingale exchangeability tests for a deployed regressor

Permutation test for exchangeability

Permutation test for exchangeability

Online martingale exchangeability tests for a deployed classifier

Online martingale exchangeability tests for a deployed classifier