English
Related papers

Related papers: Training-Conditional Coverage Bounds for Uniformly…

200 papers

In risk-sensitive learning, one aims to find a hypothesis that minimizes a risk-averse (or risk-seeking) measure of loss, instead of the standard expected loss. In this paper, we propose to study the generalization properties of…

Machine Learning · Statistics 2021-01-05 Jaeho Lee , Sejun Park , Jinwoo Shin

Quantifying the data uncertainty in learning tasks is often done by learning a prediction interval or prediction set of the label given the input. Two commonly desired properties for learned prediction sets are \emph{valid coverage} and…

Machine Learning · Computer Science 2022-05-31 Yu Bai , Song Mei , Huan Wang , Yingbo Zhou , Caiming Xiong

Time series forecasting has become a critical task due to its high practicality in real-world applications such as traffic, energy consumption, economics and finance, and disease analysis. Recent deep-learning-based approaches have shown…

Machine Learning · Computer Science 2023-05-30 Youngin Cho , Daejin Kim , Dongmin Kim , Mohammad Azam Khan , Jaegul Choo

Continual learning has been an active research area in machine learning, focusing on incrementally learning a sequence of tasks. A key challenge is catastrophic forgetting (CF), and most research efforts have been directed toward mitigating…

Machine Learning · Computer Science 2025-02-27 Saleh Momeni , Bing Liu

Predictive models are often required to produce reliable predictions under statistical conditions that are not matched to the training data. A common type of training-testing mismatch is covariate shift, where the conditional distribution…

Machine Learning · Computer Science 2025-01-22 Matteo Zecchin , Fredrik Hellström , Sangwoo Park , Shlomo Shamai , Osvaldo Simeone

Many machine learning algorithms rely on iterative updates of uncertainty representations, ranging from variational inference and expectation-maximization, to reinforcement learning, continual learning, and multi-agent learning. In the…

Machine Learning · Computer Science 2026-02-05 Michele Caprio , Siu Lun Chau , Krikamol Muandet

Learning classifiers that are robust to adversarial examples has received a great deal of recent attention. A major drawback of the standard robust learning framework is there is an artificial robustness radius $r$ that applies to all…

Machine Learning · Computer Science 2023-01-19 Robi Bhattacharjee , Kamalika Chaudhuri

This paper proposes a new framework and several results to quantify the performance of data-driven state-feedback controllers for linear systems against targeted perturbations of the training data. We focus on the case where subsets of the…

Systems and Control · Electrical Eng. & Systems 2019-12-24 Rajasekhar Anguluri , Abed AlRahman Al Makdah , Vaibhav Katewa , Fabio Pasqualetti

Hamilton-Jacobi (HJ) reachability analysis is a widely adopted verification tool to provide safety and performance guarantees for autonomous systems. However, it involves solving a partial differential equation (PDE) to compute a safety…

Robotics · Computer Science 2025-05-12 Aditya Singh , Zeyuan Feng , Somil Bansal

This paper introduces a framework for uncertainty quantification in regression models defined in metric spaces. Leveraging a newly defined notion of homoscedasticity, we develop a conformal prediction algorithm that offers finite-sample…

Machine Learning · Statistics 2025-07-22 Gábor Lugosi , Marcos Matabuena

Continual learning for large language models is typically evaluated through accuracy retention under sequential fine-tuning. We argue that this perspective is incomplete, because uncertainty reliability can degrade earlier and more sharply…

Machine Learning · Computer Science 2026-04-28 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma

Modern black-box predictive models are often accompanied by weak performance guarantees that only hold asymptotically in the size of the dataset or require strong parametric assumptions. In response to this, split conformal prediction…

Machine Learning · Statistics 2022-10-27 Roel Hulsman

Conformal predictors are machine learning algorithms that output prediction sets that have a guarantee of marginal validity for finite samples with minimal distributional assumptions. This is a property that makes conformal predictors…

Machine Learning · Computer Science 2021-03-03 Anthony Bellotti

We derive sublinear regret bounds for undiscounted reinforcement learning in continuous state space. The proposed algorithm combines state aggregation with the use of upper confidence bounds for implementing optimism in the face of…

Machine Learning · Computer Science 2013-02-12 Ronald Ortner , Daniil Ryabko

Conformal prediction (CP) produces prediction regions with finite-sample, distribution free coverage guarantees, but its interpretation as a quantitative uncertainty tool is often left implicit. We develop a category-theoretic approach that…

Machine Learning · Statistics 2026-05-05 Michele Caprio

We address the problem of safely learning controlled stochastic dynamics from discrete-time trajectory observations, ensuring system trajectories remain within predefined safe regions during both training and deployment. Safety-critical…

Machine Learning · Statistics 2026-02-03 Luc Brogat-Motte , Alessandro Rudi , Riccardo Bonalli

Although conformal prediction provides robust marginal coverage guarantees, achieving reliable conditional coverage for specific inputs remains challenging. While exact distribution-free conditional coverage is impossible with finite…

Machine Learning · Computer Science 2026-05-20 Qianyi Chen , Bo Li

Standard conformal prediction methods provide a marginal coverage guarantee, which means that for a random test point, the conformal prediction set contains the true label with a user-specified probability. In many classification problems,…

We consider learning methods based on the regularization of a convex empirical risk by a squared Hilbertian norm, a setting that includes linear predictors and non-linear predictors through positive-definite kernels. In order to go beyond…

Machine Learning · Computer Science 2019-06-19 Ulysse Marteau-Ferey , Dmitrii Ostrovskii , Francis Bach , Alessandro Rudi

Safe navigation for mobile robots demands policies that remain reliable under the high-consequence perception uncertainty of cluttered environments. Yet most existing safe reinforcement learning (RL) methods assess safety through average…

Robotics · Computer Science 2026-05-15 Qisong He , Xinmiao Huang , Jinwei Hu , Zhuoyun Li , Yi Dong , Changshun Wu , Xiaowei Huang