.. _sphx_glr_examples_exchangeability_testing_1-quickstart:

.. _exchangeability_testing_examples_1:

1. Quickstart
-------------

The following examples introduce MAPIE exchangeability testing on a fixed
dataset and on an online stream.



.. raw:: html

    <div class="sphx-glr-thumbnails">

.. thumbnail-parent-div-open

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This quickstart demonstrates how to test exchangeability on a labeled online stream, i.e. data arriving sequentially in batches.">

.. only:: html

  .. image:: /examples_exchangeability_testing/1-quickstart/images/thumb/sphx_glr_plot_exchangeability_online_thumb.png
    :alt:

  :ref:`sphx_glr_examples_exchangeability_testing_1-quickstart_plot_exchangeability_online.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Exchangeability testing on an online stream</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This quickstart demonstrates how to test exchangeability on a fixed dataset.">

.. only:: html

  .. image:: /examples_exchangeability_testing/1-quickstart/images/thumb/sphx_glr_plot_exchangeability_fixed_dataset_thumb.png
    :alt:

  :ref:`sphx_glr_examples_exchangeability_testing_1-quickstart_plot_exchangeability_fixed_dataset.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Exchangeability testing on a fixed dataset</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This quickstart demonstrates how to use RiskMonitoring to track the misclassification risk of a deployed binary classifier on an online stream.">

.. only:: html

  .. image:: /examples_exchangeability_testing/1-quickstart/images/thumb/sphx_glr_plot_risk_monitoring_thumb.png
    :alt:

  :ref:`sphx_glr_examples_exchangeability_testing_1-quickstart_plot_risk_monitoring.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Detect harmful shifts with RiskMonitoring</div>
    </div>


.. thumbnail-parent-div-close

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /examples_exchangeability_testing/1-quickstart/plot_exchangeability_online
   /examples_exchangeability_testing/1-quickstart/plot_exchangeability_fixed_dataset
   /examples_exchangeability_testing/1-quickstart/plot_risk_monitoring