English
Related papers

Related papers: Outside the Echo Chamber: Optimizing the Performat…

200 papers

This paper deals with the problem of accurately determining guaranteed suboptimal values of an unknown cost function on the basis of noisy measurements. We consider a set-valued variant to regression where, instead of finding a best…

Optimization and Control · Mathematics 2024-07-29 Jaap Eising , Jorge Cortes

Model predictive control solves a constrained optimization problem online in order to compute an implicit closed-loop control policy. Recursive feasibility -- guaranteeing that the optimal control problem will have a solution at every time…

Optimization and Control · Mathematics 2024-10-16 Jacob W. Knaup , Panagiotis Tsiotras

Recently, literature on dynamic coherent risk measures has broadened the choices for risk-sensitive performance evaluation. A running example includes Cumulative prospect theory and Conditional variance at risk. Most of them can be can be…

Optimization and Control · Mathematics 2020-12-14 Weixin Wang

As input data distributions evolve, the predictive performance of machine learning models tends to deteriorate. In the past, predictive performance was considered the key indicator to monitor. However, explanation aspects have come to…

Machine Learning · Computer Science 2022-10-25 Carlos Mougan , Klaus Broelemann , Gjergji Kasneci , Thanassis Tiropanis , Steffen Staab

Many decision problems in science, engineering and economics are affected by uncertain parameters whose distribution is only indirectly observable through samples. The goal of data-driven decision-making is to learn a decision from finitely…

Machine Learning · Statistics 2024-11-05 Daniel Kuhn , Peyman Mohajerin Esfahani , Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh

We consider regression in which one predicts a response $Y$ with a set of predictors $X$ across different experiments or environments. This is a common setup in many data-driven scientific fields and we argue that statistical inference can…

Methodology · Statistics 2026-03-23 Niklas Pfister , Evan G. Williams , Jonas Peters , Ruedi Aebersold , Peter Bühlmann

Statistical learning methods typically assume that the training and test data originate from the same distribution, enabling effective risk minimization. However, real-world applications frequently involve distributional shifts, leading to…

Statistics Theory · Mathematics 2025-03-27 Philip Kennerberg , Ernst C. Wit

Most machine learning models operate under the assumption that the training, testing and deployment data is independent and identically distributed (i.i.d.). This assumption doesn't generally hold true in a natural setting. Usually, the…

Machine Learning · Computer Science 2021-12-14 Kumud Lakara , Akshat Bhandari , Pratinav Seth , Ujjwal Verma

In this paper, an optimization problem with uncertain constraint coefficients is considered. Possibility theory is used to model the uncertainty. Namely, a joint possibility distribution in constraint coefficient realizations, called…

Optimization and Control · Mathematics 2023-09-07 Romain Guillaume , Adam Kasperski , Pawel Zielinski

The push-forward operation enables one to redistribute a probability measure through a deterministic map. It plays a key role in statistics and optimization: many learning problems (notably from optimal transport, generative modeling, and…

Machine Learning · Statistics 2025-05-19 Lucas de Lara , Mathis Deronzier , Alberto González-Sanz , Virgile Foy

We consider the problem of learning from training data obtained in different contexts, where the underlying context distribution is unknown and is estimated empirically. We develop a robust method that takes into account the uncertainty of…

Machine Learning · Statistics 2022-02-18 Muhammad Osama , Dave Zachariah , Petre Stoica

In this paper a class of optimization problems with uncertain linear constraints is discussed. It is assumed that the constraint coefficients are random vectors whose probability distributions are only partially known. Possibility theory is…

Optimization and Control · Mathematics 2021-11-30 Romain Guillaume , Adam Kasperski , Pawel Zielinski

Covariate shift relaxes the widely-employed independent and identically distributed (IID) assumption by allowing different training and testing input distributions. Unfortunately, common methods for addressing covariate shift by trying to…

Machine Learning · Computer Science 2018-01-02 Anqi Liu , Brian D. Ziebart

This paper explores the implications of producing forecast distributions that are optimized according to scoring rules that are relevant to financial risk management. We assess the predictive performance of optimal forecasts from…

Statistical Finance · Quantitative Finance 2023-03-06 Yuru Sun , Worapree Maneesoonthorn , Ruben Loaiza-Maya , Gael M. Martin

In order to train networks for verified adversarial robustness, it is common to over-approximate the worst-case loss over perturbation regions, resulting in networks that attain verifiability at the expense of standard performance. As shown…

This paper studies a risk-sensitive decision-making problem under uncertainty. It considers a decision-making process that unfolds over a fixed number of stages, in which a decision-maker chooses among multiple alternatives, some of which…

Optimization and Control · Mathematics 2026-01-07 Chung-Han Hsieh , Yi-Shan Wong

With the increasing pace of automation, modern robotic systems need to act in stochastic, non-stationary, partially observable environments. A range of algorithms for finding parameterized policies that optimize for long-term average…

Machine Learning · Computer Science 2019-09-04 David Nass , Boris Belousov , Jan Peters

Training machine learning and statistical models often involves optimizing a data-driven risk criterion. The risk is usually computed with respect to the empirical data distribution, but this may result in poor and unstable out-of-sample…

Machine Learning · Statistics 2024-11-11 Nicola Bariletto , Nhat Ho

Performative predictions are forecasts which influence the outcomes they aim to predict, undermining the existence of correct forecasts and standard methods of elicitation and estimation. We show that conditioning forecasts on covariates…

Statistics Theory · Mathematics 2025-10-27 Philip Boeken , Onno Zoeter , Joris M. Mooij

Many existing approaches for generating predictions in settings with distribution shift model distribution shifts as adversarial or low-rank in suitable representations. In various real-world settings, however, we might expect shifts to…

Machine Learning · Statistics 2023-10-31 Kirk Bansak , Elisabeth Paulson , Dominik Rothenhäusler