English
Related papers

Related papers: Hedging Complexity in Generalization via a Paramet…

200 papers

We consider statistical methods which invoke a min-max distributionally robust formulation to extract good out-of-sample performance in data-driven optimization and learning problems. Acknowledging the distributional uncertainty in learning…

Statistics Theory · Mathematics 2021-08-05 Jose Blanchet , Karthyek Murthy , Viet Anh Nguyen

Optimizing machine learning algorithms that are used to solve the objective function has been of great interest. Several approaches to optimize common algorithms, such as gradient descent and stochastic gradient descent, were explored. One…

Machine Learning · Computer Science 2022-10-06 Hilal AlQuabeh , Farha AlBreiki , Dilshod Azizov

This guide provides a reference for high-probability regret bounds in empirical risk minimization (ERM). The presentation is modular: we begin with intuition and general proof strategies, then state broadly applicable guarantees under…

Machine Learning · Statistics 2026-03-04 Lars van der Laan

In order to prevent conflicting or counteracting use of flexibility options, the coordination between distribution system operator and transmission system operator has to be strengthened. For this purpose, methods for the standardized…

Systems and Control · Electrical Eng. & Systems 2021-06-03 Gerster Johannes , Marcel Sarstedt , Eric MSP Veith , Sebastian Lehnhoff , Lutz Hofmann

Distributionally robust optimization (DRO) and invariant risk minimization (IRM) are two popular methods proposed to improve out-of-distribution (OOD) generalization performance of machine learning models. While effective for small models,…

Machine Learning · Computer Science 2023-01-25 Xiao Zhou , Yong Lin , Renjie Pi , Weizhong Zhang , Renzhe Xu , Peng Cui , Tong Zhang

We study decision problems under uncertainty, where the decision-maker has access to $K$ data sources that carry {\em biased} information about the underlying risk factors. The biases are measured by the mismatch between the risk factor…

Optimization and Control · Mathematics 2024-09-18 Yves Rychener , Adrian Esteban-Perez , Juan M. Morales , Daniel Kuhn

This paper presents a novel distributed robust optimization scheme for steering distributions of multi-agent systems under stochastic and deterministic uncertainty. Robust optimization is a subfield of optimization which aims to discover an…

Robotics · Computer Science 2025-01-31 Arshiya Taj Abdul , Augustinos D. Saravanos , Evangelos A. Theodorou

Large Language Models (LLMs) tend to respond correctly to prompts that align well with the data they were trained and fine-tuned on. Yet, small shifts in wording, format, or language can trigger surprisingly large failures, especially on…

Machine Learning · Computer Science 2026-05-12 Yeping Jin , Jiaming Hu , Ioannis Ch. Paschalidis

We study statistical inference and distributionally robust solution methods for stochastic optimization problems, focusing on confidence intervals for optimal values and solutions that achieve exact coverage asymptotically. We develop a…

Machine Learning · Statistics 2018-07-03 John Duchi , Peter Glynn , Hongseok Namkoong

The field of portfolio selection is an active research topic, which combines elements and methodologies from various fields, such as optimization, decision analysis, risk management, data science, forecasting, etc. The modeling and…

Portfolio Management · Quantitative Finance 2020-10-28 A. Georgantas

We study the minimal error of the Empirical Risk Minimization (ERM) procedure in the task of regression, both in the random and the fixed design settings. Our sharp lower bounds shed light on the possibility (or impossibility) of adapting…

Statistics Theory · Mathematics 2021-02-25 Gil Kur , Alexander Rakhlin

Gaussian Graphical Models (GGMs) are widely used to infer conditional dependence structures in high-dimensional data. However, standard precision matrix estimators are highly sensitive to data contamination, such as extreme outliers and…

Applications · Statistics 2026-03-25 Canruo Shen , Xintong Ji , Qiong Li , Wenzhi Yang , Xiaoping Shi

We establish a connection between distributionally robust optimization (DRO) and classical robust statistics. We demonstrate that this connection arises naturally in the context of estimation under data corruption, where the goal is to…

Optimization and Control · Mathematics 2024-10-21 Gabriel Chan , Bart Van Parys , Amine Bennouna

Submodular functions have applications throughout machine learning, but in many settings, we do not have direct access to the underlying function $f$. We focus on stochastic functions that are given as an expectation of functions over a…

Machine Learning · Computer Science 2018-06-07 Matthew Staib , Bryan Wilder , Stefanie Jegelka

We propose a novel approach for domain generalisation (DG) leveraging risk distributions to characterise domains, thereby achieving domain invariance. In our findings, risk distributions effectively highlight differences between training…

Machine Learning · Computer Science 2023-10-31 Toan Nguyen , Kien Do , Bao Duong , Thin Nguyen

In recent years, two prominent paradigms have shaped distributionally robust optimization (DRO), modeling distributional ambiguity through $\phi$-divergences and Wasserstein distances, respectively. While the former focuses on ambiguity in…

Optimization and Control · Mathematics 2025-12-22 Jose Blanchet , Daniel Kuhn , Jiajin Li , Bahar Taskesen

Empirical Risk Minimization (ERM) algorithms are widely used in a variety of estimation and prediction tasks in signal-processing and machine learning applications. Despite their popularity, a theory that explains their statistical…

Machine Learning · Statistics 2020-07-07 Hossein Taheri , Ramtin Pedarsani , Christos Thrampoulidis

In this paper, we study the two-stage distributionally robust optimization (DRO) problem from the primal perspective. Unlike existing approaches, this perspective allows us to build a deeper and more intuitive understanding on DRO, to…

Optimization and Control · Mathematics 2024-12-31 Zhengsong Lu , Bo Zeng

Recent work has shown that standard training via empirical risk minimization (ERM) can produce models that achieve high accuracy on average but low accuracy on underrepresented groups due to the prevalence of spurious features. A…

Machine Learning · Computer Science 2023-05-11 Yachuan Liu , Bohan Zhang , Qiaozhu Mei , Paramveer Dhillon

In this study we analyze linear mixed-integer programming problems, in which the distribution of the cost vector is only observable through a finite training data set. In contrast to the related studies, we assume that the number of random…

Optimization and Control · Mathematics 2022-05-20 Sergey S. Ketkov , Andrei S. Shilov