English
Related papers

Related papers: Loss-Controlling Calibration for Predictive Models

200 papers

We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems…

Systems and Control · Electrical Eng. & Systems 2022-12-05 Rohan Sinha , James Harrison , Spencer M. Richards , Marco Pavone

Uncertainty quantification is essential in decision-making, especially when joint distributions of random variables are involved. While conformal prediction provides distribution-free prediction sets with valid coverage guarantees, it…

Machine Learning · Computer Science 2025-01-03 Rui Luo , Zhixin Zhou

The need for control strategies that can address dynamic system uncertainty is becoming increasingly important. In this work, we propose a Model Predictive Control by quantifying the risk of failure in our system model. The proposed control…

Systems and Control · Electrical Eng. & Systems 2023-02-17 Mostafa Tavakkoli Anbarani , Efe C. Balta , Rômulo Meira-Góes , Ilya Kovalenko

Combining efficient and safe control for safety-critical systems is challenging. Robust methods may be overly conservative, whereas probabilistic controllers require a trade-off between efficiency and safety. In this work, we propose a…

Systems and Control · Electrical Eng. & Systems 2022-09-16 Tim Brüdigam , Robert Jacumet , Dirk Wollherr , Marion Leibold

Performative prediction is a framework for learning models that influence the data they intend to predict. We focus on finding classifiers that are performatively stable, i.e. optimal for the data distribution they induce. Standard…

Machine Learning · Computer Science 2025-02-07 Mehrnaz Mofakhami , Ioannis Mitliagkas , Gauthier Gidel

This paper investigates gradient-based adaptive prediction and control for nonlinear stochastic dynamical systems under a weak convexity condition on the prediction-based loss. This condition accommodates a broad range of nonlinear models…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Yujing Liu , Xin Zheng , Zhixin Liu , Lei Guo

Early stopping based on hold-out data is a popular regularization technique designed to mitigate overfitting and increase the predictive accuracy of neural networks. Models trained with early stopping often provide relatively accurate…

Machine Learning · Statistics 2023-06-28 Ziyi Liang , Yanfei Zhou , Matteo Sesia

This paper presents early work aiming at the development of a new framework for the design and analysis of algorithms for online learning based prediction and control. Firstly, we consider the task of predicting values of a function or time…

Optimization and Control · Mathematics 2019-03-26 Jan-P. Calliess

In many contexts, customized and weighted classification scores are designed in order to evaluate the goodness of the predictions carried out by neural networks. However, there exists a discrepancy between the maximization of such scores…

Machine Learning · Computer Science 2023-05-24 Francesco Marchetti , Sabrina Guastavino , Cristina Campi , Federico Benvenuto , Michele Piana

Sharing forecasts of network timeseries data, such as cellular or electricity load patterns, can improve independent control applications ranging from traffic scheduling to power generation. Typically, forecasts are designed without…

Machine Learning · Computer Science 2021-10-06 Jiangnan Cheng , Marco Pavone , Sachin Katti , Sandeep Chinchali , Ao Tang

Conformal prediction offers a distribution-free framework for constructing prediction sets with coverage guarantees. In practice, multiple valid conformal prediction sets may be available, arising from different models or methodologies.…

Machine Learning · Statistics 2025-06-26 Mahmoud Hegazy , Liviu Aolaritei , Michael I. Jordan , Aymeric Dieuleveut

We derive computationally tractable methods to select a small subset of experiment settings from a large pool of given design points. The primary focus is on linear regression models, while the technique extends to generalized linear models…

Machine Learning · Statistics 2017-12-21 Yining Wang , Adams Wei Yu , Aarti Singh

The key factor in implementing machine learning algorithms in decision-making situations is not only the accuracy of the model but also its confidence level. The confidence level of a model in a classification problem is often given by the…

Machine Learning · Statistics 2024-05-02 Masanari Kimura , Hiroki Naganuma

Transformers have become a standard architecture in machine learning, demonstrating strong in-context learning (ICL) abilities that allow them to learn from the prompt at inference time. However, uncertainty quantification for ICL remains…

Machine Learning · Statistics 2025-04-23 Zhe Huang , Simone Rossi , Rui Yuan , Thomas Hannagan

Existing approaches of prescriptive analytics -- where inputs of an optimization model can be predicted by leveraging covariates in a machine learning model -- often attempt to optimize the mean value of an uncertain objective. However,…

Machine Learning · Computer Science 2025-03-05 Dimitris Bertsimas , Benjamin Boucher

The prediction accuracy of machine learning methods is steadily increasing, but the calibration of their uncertainty predictions poses a significant challenge. Numerous works focus on obtaining well-calibrated predictive models, but less is…

Machine Learning · Statistics 2023-12-07 Donghwan Lee , Xinmeng Huang , Hamed Hassani , Edgar Dobriban

Several uncertainty estimation methods have been recently proposed for machine translation evaluation. While these methods can provide a useful indication of when not to trust model predictions, we show in this paper that the majority of…

Computation and Language · Computer Science 2023-06-13 Chrysoula Zerva , André F. T. Martins

Conformal prediction is emerging as a popular paradigm for providing rigorous uncertainty quantification in machine learning since it can be easily applied as a post-processing step to already trained models. In this paper, we extend…

Machine Learning · Computer Science 2023-06-02 Charles Lu , Yaodong Yu , Sai Praneeth Karimireddy , Michael I. Jordan , Ramesh Raskar

Time-varying stochastic optimization problems frequently arise in machine learning practice (e.g. gradual domain shift, object tracking, strategic classification). Although most problems are solved in discrete time, the underlying process…

Machine Learning · Computer Science 2023-02-24 Subha Maity , Debarghya Mukherjee , Moulinath Banerjee , Yuekai Sun

Model predictive control (MPC) has established itself as the primary methodology for constrained control, enabling general-purpose robot autonomy in diverse real-world scenarios. However, for most problems of interest, MPC relies on the…