English
Related papers

Related papers: Adaptive Calibration in Non-Stationary Environment…

200 papers

In this paper, we study oracle-efficient algorithms for beyond worst-case analysis of online learning. We focus on two settings. First, the smoothed analysis setting of [RST11,HRS22] where an adversary is constrained to generating samples…

Machine Learning · Computer Science 2022-11-23 Nika Haghtalab , Yanjun Han , Abhishek Shetty , Kunhe Yang

While modern deep neural networks are performant perception modules, performance (accuracy) alone is insufficient, particularly for safety-critical robotic applications such as self-driving vehicles. Robot autonomy stacks also require these…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Dhaivat Bhatt , Kaustubh Mani , Dishank Bansal , Krishna Murthy , Hanju Lee , Liam Paull

Accurate estimation of predictive uncertainty (model calibration) is essential for the safe application of neural networks. Many instances of miscalibration in modern neural networks have been reported, suggesting a trend that newer, more…

Machine Learning · Computer Science 2021-10-27 Matthias Minderer , Josip Djolonga , Rob Romijnders , Frances Hubis , Xiaohua Zhai , Neil Houlsby , Dustin Tran , Mario Lucic

Contextual MDPs are powerful tools with wide applicability in areas from biostatistics to machine learning. However, specializing them to offline datasets has been challenging due to a lack of robust, theoretically backed methods. Our work…

Machine Learning · Statistics 2026-05-06 Riddhiman Bhattacharyya , Sayak Chakrabarty , Imon Banerjee

Automated driving systems use multi-modal sensor suites to ensure the reliable, redundant and robust perception of the operating domain, for example camera and LiDAR. An accurate extrinsic calibration is required to fuse the camera and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Jack Borer , Jeremy Tschirner , Florian Ölsner , Stefan Milz

Precision matrix estimation is a fundamental topic in multivariate statistics and modern machine learning. This paper proposes an adversarially perturbed precision matrix estimation framework, motivated by recent developments in adversarial…

Methodology · Statistics 2026-03-25 Yiling Xie

In online advertising, uncertainty calibration aims to adjust a ranking model's probability predictions to better approximate the true likelihood of an event, e.g., a click or a conversion. However, existing calibration approaches may lack…

Machine Learning · Computer Science 2025-03-04 Quanyu Dai , Jiaren Xiao , Zhaocheng Du , Jieming Zhu , Chengxiao Luo , Xiao-Ming Wu , Zhenhua Dong

Uncertainty estimates must be calibrated (i.e., accurate) and sharp (i.e., informative) in order to be useful. This has motivated a variety of methods for recalibration, which use held-out data to turn an uncalibrated model into a…

Machine Learning · Computer Science 2022-07-06 Charles Marx , Shengjia Zhao , Willie Neiswanger , Stefano Ermon

This paper develops a conformal method to compute prediction intervals for non-parametric regression that can automatically adapt to skewed data. Leveraging black-box machine learning algorithms to estimate the conditional distribution of…

Methodology · Statistics 2021-10-26 Matteo Sesia , Yaniv Romano

Recent literature has made much progress in understanding \emph{online LQR}: a modern learning-theoretic take on the classical control problem in which a learner attempts to optimally control an unknown linear dynamical system with fully…

Machine Learning · Computer Science 2020-10-06 Max Simchowitz

Safety-critical control of uncertain, adaptive systems often relies on conservative, worst-case uncertainty bounds that limit closed-loop performance. Online conformal prediction is a powerful data-driven method for quantifying uncertainty…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Daniel M. Cherenson , Dimitra Panagou

We consider the general problem of learning a predictor that satisfies multiple objectives of interest simultaneously, a broad framework that captures a range of specific learning goals including calibration, regret, and multiaccuracy. We…

Machine Learning · Computer Science 2026-02-17 Jivat Neet Kaur , Isaac Gibbs , Michael I. Jordan

We introduce algorithms for online, full-information prediction that are competitive with contextual tree experts of unknown complexity, in both probabilistic and adversarial settings. We show that by incorporating a probabilistic framework…

Machine Learning · Computer Science 2018-05-23 Vidya Muthukumar , Mitas Ray , Anant Sahai , Peter L. Bartlett

In machine learning, model calibration and predictive inference are essential for producing reliable predictions and quantifying uncertainty to support decision-making. Recognizing the complementary roles of point and interval predictions,…

Machine Learning · Statistics 2024-11-01 Lars van der Laan , Ahmed M. Alaa

Quantum-phase-estimation algorithms are critical subroutines in many applications for quantum computers and in quantum-metrology protocols. These algorithms estimate the unknown strength of a unitary evolution. By using coherence or…

Quantum Physics · Physics 2023-03-06 Joseph G. Smith , Crispin H. W. Barnes , David R. M. Arvidsson-Shukur

This paper considers an optimization problem for a dynamical system whose evolution depends on a collection of binary decision variables. We develop scalable approximation algorithms with provable suboptimality bounds to provide…

Optimization and Control · Mathematics 2016-10-31 Insoon Yang , Samuel A. Burden , Ram Rajagopal , S. Shankar Sastry , Claire J. Tomlin

Many robotic systems are underactuated, meaning not all degrees of freedom can be directly controlled due to lack of actuators, input constraints, or state-dependent actuation. This property, compounded by modeling uncertainties and…

Systems and Control · Electrical Eng. & Systems 2025-10-10 Daniel M. Cherenson , Dimitra Panagou

Selecting an effective step-size is a fundamental challenge in first-order optimization, especially for problems with non-Euclidean geometries. This paper presents a novel adaptive step-size strategy for optimization algorithms that rely on…

Optimization and Control · Mathematics 2025-10-14 Abbas Khademi , Antonio Silveti-Falls

We address the problem of uncertainty calibration. While standard deep neural networks typically yield uncalibrated predictions, calibrated confidence scores that are representative of the true likelihood of a prediction can be achieved…

Machine Learning · Computer Science 2021-06-24 Christian Tomani , Sebastian Gruber , Muhammed Ebrar Erdem , Daniel Cremers , Florian Buettner

We develop new adaptive algorithms for variational inequalities with monotone operators, which capture many problems of interest, notably convex optimization and convex-concave saddle point problems. Our algorithms automatically adapt to…

Machine Learning · Computer Science 2021-08-30 Alina Ene , Huy L. Nguyen