English
Related papers

Related papers: Conformal Risk Control for Ordinal Classification

200 papers

Recent years have seen many advances in methods for causal structure learning from data. The empirical assessment of such methods, however, is much less developed. Motivated by this gap, we pose the following question: how can one assess,…

Methodology · Statistics 2020-06-30 Marco F. Eigenmann , Sach Mukherjee , Marloes H. Maathuis

In online selective conformal inference, data arrives sequentially, and prediction intervals are constructed only when an online selection rule is met. Since online selections may break the exchangeability between the selected test datum…

Machine Learning · Statistics 2025-03-24 Yusuf Sale , Aaditya Ramdas

In strategic classification, an institution (e.g., a bank) anticipates adaptation from users who change their features to increase utility in a classification task (e.g., loan repayment). Since a key challenge is the distribution shift…

Machine Learning · Computer Science 2026-05-27 Antonio Gois , Sophia Gunluk , Nir Rosenfeld , Nidhi Hegde , Simon Lacoste-Julien , Dhanya Sridhar

We consider the Chance Constrained Model Predictive Control problem for polynomial systems subject to disturbances. In this problem, we aim at finding optimal control input for given disturbed dynamical system to minimize a given cost…

Optimization and Control · Mathematics 2016-05-04 Ashkan Jasour , Constantino Lagoa

Methods for split conformal prediction leverage calibration samples to transform any prediction rule into a set-prediction rule that complies with a target coverage probability. Existing methods provide remarkably strong performance…

Machine Learning · Statistics 2025-10-15 Santiago Mazuelas

In many real-world problems, predictions are leveraged to monitor and control cyber-physical systems, demanding guarantees on the satisfaction of reliability and safety requirements. However, predictions are inherently uncertain, and…

Information Theory · Computer Science 2023-10-17 Matteo Zecchin , Sangwoo Park , Osvaldo Simeone

Learning beneficial treatment allocations for a patient population is an important problem in precision medicine. Many treatments come with adverse side effects that are not commensurable with their potential benefits. Patients who do not…

Machine Learning · Statistics 2025-05-14 Sofia Ek , Dave Zachariah

Predictive inference is a fundamental task in statistics, traditionally addressed using parametric assumptions about the data distribution and detailed analyses of how models learn from data. In recent years, conformal prediction has…

Methodology · Statistics 2026-03-26 Matteo Sesia , Stefano Favaro

Conformal prediction is a framework for uncertainty quantification that constructs prediction sets for previously unseen data, guaranteeing coverage of the true label with a specified probability. However, the efficiency of these prediction…

Machine Learning · Computer Science 2026-01-06 Erfan Hajihashemi , Yanning Shen

In ordinal classification, misclassifying neighboring ranks is common, yet the consequences of these errors are not the same. For example, misclassifying benign tumor categories is less consequential, compared to an error at the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Dileepa Pitawela , Gustavo Carneiro , Hsiang-Ting Chen

Wildfires are highly imbalanced natural hazards in both space and severity, making the prediction of extreme events particularly challenging. In this work, we introduce the first ordinal classification framework for forecasting wildfire…

Machine Learning · Computer Science 2026-05-26 Nicolas Caron , Christophe Guyeux , Hassan Noura , Benjamin Aynes

Ordinal measurements are common outcomes in studies within psychology, as well as in the social and behavioral sciences. Choosing an appropriate regression model for analysing such data poses a difficult task. This paper aims to facilitate…

Methodology · Statistics 2026-03-03 Stefan Inerle , Markus Pauly , Moritz Berger

This article addresses the problem of functional supervised classification of Cox process trajectories, whose random intensity is driven by some exogenous random covariable. The classification task is achieved through a regularized convex…

Statistics Theory · Mathematics 2014-10-16 Gérard Biau , Benoît Cadre , Quentin Paris

Evaluating conditional coverage remains one of the most persistent challenges in assessing the reliability of predictive systems. Although conformal methods can give guarantees on marginal coverage, no method can guarantee to produce sets…

Machine Learning · Statistics 2025-12-15 Sacha Braun , David Holzmüller , Michael I. Jordan , Francis Bach

Checklists are simple decision aids that are often used to promote safety and reliability in clinical applications. In this paper, we present a method to learn checklists for clinical decision support. We represent predictive checklists as…

Machine Learning · Computer Science 2022-01-19 Haoran Zhang , Quaid Morris , Berk Ustun , Marzyeh Ghassemi

An agent must try new behaviors to explore and improve. In high-stakes environments, an agent that violates safety constraints may cause harm and must be taken offline, curtailing any future interaction. Imitating old behavior is safe, but…

Artificial Intelligence · Computer Science 2026-04-17 Drew Prinster , Clara Fannjiang , Ji Won Park , Kyunghyun Cho , Anqi Liu , Suchi Saria , Samuel Stanton

Conformal inference provides a rigorous statistical framework for uncertainty quantification in machine learning, enabling well-calibrated prediction sets with precise coverage guarantees for any classification model. However, its reliance…

Conformal prediction uses past experience to determine precise levels of confidence in new predictions. Given an error probability $\epsilon$, together with a method that makes a prediction $\hat{y}$ of a label $y$, it produces a set of…

Machine Learning · Computer Science 2019-04-23 Glenn Shafer , Vladimir Vovk

A regression model is proposed for the analysis of an ordinal response variable depending on a set of multiple covariates containing ordinal and potentially other variables. The proportional odds model (McCullagh (1980)) is used for the…

Methodology · Statistics 2018-04-25 Javier Espinosa , Christian Hennig

Conformal inference has played a pivotal role in providing uncertainty quantification for black-box ML prediction algorithms with finite sample guarantees. Traditionally, conformal prediction inference requires a data-independent…

Methodology · Statistics 2023-07-04 Siddhaarth Sarkar , Arun Kumar Kuchibhotla