English
Related papers

Related papers: Risk Guarantees for End-to-End Prediction and Opti…

200 papers

In most machine learning training paradigms a fixed, often handcrafted, loss function is assumed to be a good proxy for an underlying evaluation metric. In this work we assess this assumption by meta-learning an adaptive loss function to…

Machine Learning · Computer Science 2019-05-16 Chen Huang , Shuangfei Zhai , Walter Talbott , Miguel Angel Bautista , Shih-Yu Sun , Carlos Guestrin , Josh Susskind

This contribution examines optimization problems that involve stochastic dominance constraints. These problems have uncountably many constraints. We develop methods to solve the optimization problem by reducing the constraints to a finite…

Optimization and Control · Mathematics 2025-02-27 Rajmadan Lakshmanan , Alois Pichler , Miloš Kopa

Conditions ensuring optimal parameter estimation in the presence of missing data are well established in inference, typically relying on the Missing-at-Random (MAR) assumption. In prediction, similar principles are often assumed to apply.…

Methodology · Statistics 2026-03-19 Pierre Catoire , Robin Genuer , Cecile Proust-Lima

Decision-makers often act in response to data-driven predictions, with the goal of achieving favorable outcomes. In such settings, predictions don't passively forecast the future; instead, predictions actively shape the distribution of…

Machine Learning · Computer Science 2023-01-10 Michael P. Kim , Juan C. Perdomo

Every prediction is ultimately used in a downstream task. Consequently, evaluating prediction quality is more meaningful when considered in the context of its downstream use. Metrics based solely on predictive performance often diverge from…

Machine Learning · Computer Science 2025-08-26 Novin Shahroudi , Viacheslav Komisarenko , Meelis Kull

We initiate a formal study of reproducibility in optimization. We define a quantitative measure of reproducibility of optimization procedures in the face of noisy or error-prone operations such as inexact or stochastic gradient computations…

Optimization and Control · Mathematics 2022-12-06 Kwangjun Ahn , Prateek Jain , Ziwei Ji , Satyen Kale , Praneeth Netrapalli , Gil I. Shamir

We consider the problem of constructing probabilistic predictions that lead to accurate decisions when employed by downstream users to inform actions. For a single decision maker, designing an optimal predictor is equivalent to minimizing a…

Machine Learning · Computer Science 2025-10-15 Isaac Gibbs , Ryan J. Tibshirani

Robust optimization safeguards decisions against uncertainty by optimizing against worst-case scenarios, yet their effectiveness hinges on a prespecified robustness level that is often chosen ad hoc, leading to either insufficient…

Machine Learning · Statistics 2026-02-02 Wenbin Zhou , Shixiang Zhu

Our goal is to compute a policy that guarantees improved return over a baseline policy even when the available MDP model is inaccurate. The inaccurate model may be constructed, for example, by system identification techniques when the true…

Optimization and Control · Mathematics 2015-06-17 Yinlam Chow , Marek Petrik , Mohammad Ghavamzadeh

Optimality is a critical aspect of Model Predictive Control (MPC), especially in economic MPC. However, achieving optimality in MPC presents significant challenges, and may even be impossible, due to inherent inaccuracies in the predictive…

Optimization and Control · Mathematics 2024-12-25 Akhil S Anand , Arash Bahari Kordabad , Mario Zanon , Sebastien Gros

Measuring and managing risk has become crucial in modern decision making under stochastic uncertainty. In two-stage stochastic programming, mean risk models are essentially defined by a parametric recourse problem and a quantification of…

Optimization and Control · Mathematics 2016-11-28 Matthias Claus , Volker Krätschmer , Rüdiger Schultz

Toward a multi-objective optimization robust problem, the variations in design variables and design environment pa-rameters include the small variations and the large varia-tions. The former have small effect on the performance func-tions…

Optimization and Control · Mathematics 2014-12-04 Weijun Wang , Stéphane Caro , Fouad Bennis , Ricardo Soto , Broderick Crawford

Scientific applications typically generate large volumes of floating-point data, making lossy compression one of the most effective methods for data reduction, thereby lowering storage requirements and improving performance in large-scale…

Performance · Computer Science 2024-12-11 Youyuan Liu , Taolue Yang , Sian Jin

When predictions are performative, the choice of which predictor to deploy influences the distribution of future observations. The overarching goal in learning under performativity is to find a predictor that has low \emph{performative…

Machine Learning · Computer Science 2024-05-29 Licong Lin , Tijana Zrnic

Our work revisits the design of mechanisms via the learning-augmented framework. In this model, the algorithm is enhanced with imperfect (machine-learned) information concerning the input, usually referred to as prediction. The goal is to…

Computer Science and Game Theory · Computer Science 2024-10-29 George Christodoulou , Alkmini Sgouritsa , Ioannis Vlachos

The vast majority of statistical theory on binary classification characterizes performance in terms of accuracy. However, accuracy is known in many cases to poorly reflect the practical consequences of classification error, most famously in…

Statistics Theory · Mathematics 2022-09-27 Shashank Singh , Justin Khim

We present a new perspective on loss minimization and the recent notion of Omniprediction through the lens of Outcome Indistingusihability. For a collection of losses and hypothesis class, omniprediction requires that a predictor provide a…

Machine Learning · Computer Science 2022-12-09 Parikshit Gopalan , Lunjia Hu , Michael P. Kim , Omer Reingold , Udi Wieder

We provide necessary and sufficient conditions for robust efficiency (in the sense of Ehrgott et al. (2014)) to multiobjective optimization problems that depend on uncertain parameters. These conditions state that a solution is robust…

Optimization and Control · Mathematics 2017-05-30 Rasmus Bokrantz , Albin Fredriksson

We study convex empirical risk minimization for high-dimensional inference in binary models. Our first result sharply predicts the statistical performance of such estimators in the linear asymptotic regime under isotropic Gaussian features.…

Statistics Theory · Mathematics 2020-02-27 Hossein Taheri , Ramtin Pedarsani , Christos Thrampoulidis

Machine learning applications frequently come with multiple diverse objectives and constraints that can change over time. Accordingly, trained models can be tuned with sets of hyper-parameters that affect their predictive behavior (e.g.,…

Machine Learning · Computer Science 2022-10-17 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola
‹ Prev 1 3 4 5 6 7 10 Next ›