English
Related papers

Related papers: Data-driven Analysis of First-Order Methods via Di…

200 papers

This paper solves a new class of optimization problems under uncertainty, called Probable Event Constrained Optimization (PECO), which optimizes an objective function of decision variables and subjects to a set of Probable Event Constraints…

Optimization and Control · Mathematics 2025-03-07 Qifeng Li

This paper proposes distributed algorithms to solve robust convex optimization (RCO) when the constraints are affected by nonlinear uncertainty. We adopt a scenario approach by randomly sampling the uncertainty set. To facilitate the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-16 Keyou You , Roberto Tempo , Pei Xie

Attention to data-driven optimization approaches, including the well-known stochastic gradient descent method, has grown significantly over recent decades, but data-driven constraints have rarely been studied, because of the computational…

Machine Learning · Computer Science 2023-10-11 Shuoguang Yang , Xudong Li , Guanghui Lan

We investigate a data-driven quasiconcave maximization problem where information about the objective function is limited to a finite sample of data points. We begin by defining an ambiguity set for admissible objective functions based on…

Optimization and Control · Mathematics 2026-04-07 Jian Wu , William B. Haskell , Wenjie Huang , Huifu Xu

We consider the distributionally robust optimization (DRO) model of principal component analysis (PCA) to account for uncertainty in the underlying probability distribution. The resulting formulation leads to a nonsmooth constrained min-max…

Optimization and Control · Mathematics 2025-07-14 Lei Wang , Xin Liu , Xiaojun Chen

In this work, we present an algorithmically tractable safe approximation of distributionally robust optimization (DRO) problems that contain univariate indicator functions. The latter appear in different applications, but render the model…

Optimization and Control · Mathematics 2026-01-22 Jana Dienstbier , Frauke Liers , Florian Rösel , Jan Rolfes

We introduce the notion of Worst-Case Sensitivity, defined as the worst-case rate of increase in the expected cost of a Distributionally Robust Optimization (DRO) model when the size of the uncertainty set vanishes. We show that worst-case…

Econometrics · Economics 2020-10-22 Jun-ya Gotoh , Michael Jong Kim , Andrew E. B. Lim

Distributionally robust optimization (DRO) is an effective approach for data-driven decision-making in the presence of uncertainty. Geometric uncertainty due to sampling or localized perturbations of data points is captured by Wasserstein…

Machine Learning · Statistics 2023-11-10 Sloan Nietert , Ziv Goldfeld , Soroosh Shafiee

When the underlying probability distribution in a stochastic optimization is observed only through data, various data-driven formulations have been studied to obtain approximate optimal solutions. We show that no such formulations can, in a…

Optimization and Control · Mathematics 2021-05-31 Henry Lam

Uncertainties from deepening penetration of renewable energy resources have posed critical challenges to the secure and reliable operations of future electric grids. Among various approaches for decision making in uncertain environments,…

Optimization and Control · Mathematics 2019-04-16 Xinbo Geng , Le Xie

We study control of constrained linear systems with only partial statistical information about the uncertainty affecting the system dynamics and the sensor measurements. Specifically, given a finite collection of disturbance realizations…

Optimization and Control · Mathematics 2024-07-15 Jean-Sébastien Brouillon , Andrea Martin , John Lygeros , Florian Dörfler , Giancarlo Ferrari Trecate

The effects of treatments are often heterogeneous, depending on the observable characteristics, and it is necessary to exploit such heterogeneity to devise individualized treatment rules (ITRs). Existing estimation methods of such ITRs…

Econometrics · Economics 2022-08-09 Daido Kido

Distributionally robust chance constrained programs minimize a deterministic cost function subject to the satisfaction of one or more safety conditions with high probability, given that the probability distribution of the uncertain problem…

Optimization and Control · Mathematics 2022-11-22 Zhi Chen , Daniel Kuhn , Wolfram Wiesemann

Distributionally robust optimization (DRO) studies decision problems under uncertainty where the probability distribution governing the uncertain problem parameters is itself uncertain. A key component of any DRO model is its ambiguity set,…

Optimization and Control · Mathematics 2025-05-28 Daniel Kuhn , Soroosh Shafiee , Wolfram Wiesemann

We provide a framework for computing the exact worst-case performance of any algorithm belonging to a broad class of oracle-based first-order methods for composite convex optimization, including those performing explicit, projected,…

Optimization and Control · Mathematics 2019-11-22 Adrien B. Taylor , Julien M. Hendrickx , François Glineur

We introduce a class of first-order methods for smooth constrained optimization that are based on an analogy to non-smooth dynamical systems. Two distinctive features of our approach are that (i) projections or optimizations over the entire…

Optimization and Control · Mathematics 2025-04-15 Michael Muehlebach , Michael I. Jordan

Training machine learning and statistical models often involves optimizing a data-driven risk criterion. The risk is usually computed with respect to the empirical data distribution, but this may result in poor and unstable out-of-sample…

Machine Learning · Statistics 2024-11-11 Nicola Bariletto , Nhat Ho

We propose a data-driven control method for systems with aleatoric uncertainty, for example, robot fleets with variations between agents. Our method leverages shared trajectory data to increase the robustness of the designed controller and…

Robotics · Computer Science 2024-03-25 Alexander von Rohr , Dmitrii Likhachev , Sebastian Trimpe

Despite superior performance in many situations, deep neural networks are often vulnerable to adversarial examples and distribution shifts, limiting model generalization ability in real-world applications. To alleviate these problems,…

Machine Learning · Computer Science 2023-02-14 Hoang Phan , Trung Le , Trung Phung , Tuan Anh Bui , Nhat Ho , Dinh Phung

Distributionally robust optimization (DRO) provides a framework for training machine learning models that are able to perform well on a collection of related data distributions (the "uncertainty set"). This is done by solving a min-max…

Machine Learning · Computer Science 2021-04-01 Paul Michel , Tatsunori Hashimoto , Graham Neubig