.. _sphx_glr_examples_calibration_1-quickstart:

.. _calibration_examples_1:

1. Quickstart examples
----------------------

The following examples present the main functionalities of MAPIE through basic quickstart calibration problems.


.. raw:: html

    <div class="sphx-glr-thumbnails">

.. thumbnail-parent-div-open

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This example shows how to calibrate a binary classifier with VennAbersCalibrator and visualize the impact on predicted probabilities.">

.. only:: html

  .. image:: /examples_calibration/1-quickstart/images/thumb/sphx_glr_plot_calibration_venn_abers_binary_thumb.png
    :alt:

  :ref:`sphx_glr_examples_calibration_1-quickstart_plot_calibration_venn_abers_binary.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Calibrating binary classifier with Venn-ABERS</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This example uses kolmogorov_smirnov_pvalue to test for calibration of scores output by binary classifiers. Other alternatives are kuiper_pvalue and spieglehalter_pvalue.">

.. only:: html

  .. image:: /examples_calibration/1-quickstart/images/thumb/sphx_glr_plot_calibration_hypothesis_testing_thumb.png
    :alt:

  :ref:`sphx_glr_examples_calibration_1-quickstart_plot_calibration_hypothesis_testing.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Testing for calibration in binary classification settings</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This example shows how to calibrate a multi-class classifier with VennAbersCalibrator and visualize the impact on predicted probabilities. We compare an uncalibrated model against its Venn-ABERS calibrated version using reliability diagrams and multi-class Brier scores.">

.. only:: html

  .. image:: /examples_calibration/1-quickstart/images/thumb/sphx_glr_plot_calibration_venn_abers_multiclass_thumb.png
    :alt:

  :ref:`sphx_glr_examples_calibration_1-quickstart_plot_calibration_venn_abers_multiclass.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Calibrating multi-class classifier with Venn-ABERS</div>
    </div>


.. thumbnail-parent-div-close

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /examples_calibration/1-quickstart/plot_calibration_venn_abers_binary
   /examples_calibration/1-quickstart/plot_calibration_hypothesis_testing
   /examples_calibration/1-quickstart/plot_calibration_venn_abers_multiclass