MAPIE

MAPIE is an open-source Python library for quantifying uncertainties and controlling the risks of machine learning models. It is a scikit-learn-contrib project that allows you to:

• Easily compute conformal prediction intervals (or prediction sets) with controlled (or guaranteed) marginal coverage rate for regression, classification (binary and multi-class), and time series.
• Easily control risks of more complex tasks such as multi-label classification, semantic segmentation in computer vision (probabilistic guarantees on recall, precision, etc.).
• Easily wrap any model (scikit-learn, TensorFlow, PyTorch, etc.) with, if needed, a scikit-learn-compatible wrapper for the purposes just mentioned.