English
Related papers

Related papers: Online Stochastic Optimization with Wasserstein Ba…

200 papers

Optimal transport is widely used to learn distributions, enforce distributional constraints, and model uncertainty. In applications, transport losses are often computed from samples through tractable representations, such as one-dimensional…

Optimization and Control · Mathematics 2026-05-28 Tam Le

Distributionally robust optimization (DRO) has become a powerful framework for estimation under uncertainty, offering strong out-of-sample performance and principled regularization. In this paper, we propose a DRO-based method for linear…

Machine Learning · Statistics 2025-05-06 Liviu Aolaritei , Soroosh Shafiee , Florian Dörfler

Offline reinforcement learning (RL) aims to learn an optimal policy from a static dataset, making it particularly valuable in scenarios where data collection is costly, such as robotics. A major challenge in offline RL is distributional…

Machine Learning · Computer Science 2025-07-16 Motoki Omura , Yusuke Mukuta , Kazuki Ota , Takayuki Osa , Tatsuya Harada

In many applications in statistics and machine learning, the availability of data samples from multiple possibly heterogeneous sources has become increasingly prevalent. On the other hand, in distributionally robust optimization, we seek…

Machine Learning · Statistics 2022-05-31 Tim Tsz-Kit Lau , Han Liu

Modern stochastic optimization methods often rely on uniform sampling which is agnostic to the underlying characteristics of the data. This might degrade the convergence by yielding estimates that suffer from a high variance. A possible…

Machine Learning · Statistics 2018-06-07 Zalán Borsos , Andreas Krause , Kfir Y. Levy

This paper considers optimization problems over networks where agents have individual objectives to meet, or individual parameter vectors to estimate, subject to subspace constraints that require the objectives across the network to lie in…

Multiagent Systems · Computer Science 2020-04-22 Roula Nassif , Stefan Vlaski , Ali H. Sayed

We consider online learning algorithms that guarantee worst-case regret rates in adversarial environments (so they can be deployed safely and will perform robustly), yet adapt optimally to favorable stochastic environments (so they will…

Machine Learning · Computer Science 2021-08-31 Wouter M. Koolen , Peter Grünwald , Tim van Erven

We study online convex optimization in the random order model, recently proposed by \citet{garber2020online}, where the loss functions may be chosen by an adversary, but are then presented to the online algorithm in a uniformly random…

Machine Learning · Computer Science 2021-06-30 Uri Sherman , Tomer Koren , Yishay Mansour

Stochastic optimization problems often involve data distributions that change in reaction to the decision variables. This is the case for example when members of the population respond to a deployed classifier by manipulating their features…

Optimization and Control · Mathematics 2020-12-15 Dmitriy Drusvyatskiy , Lin Xiao

We investigate the Distributionally Robust Regret-Optimal (DR-RO) control of discrete-time linear dynamical systems with quadratic cost over an infinite horizon. Regret is the difference in cost obtained by a causal controller and a…

Systems and Control · Electrical Eng. & Systems 2024-01-01 Taylan Kargin , Joudi Hajar , Vikrant Malik , Babak Hassibi

In this work, we analyze the properties of the solution to the covariance steering problem for discrete time Gaussian linear systems with a squared Wasserstein distance terminal cost. In our previous work, we have shown that by utilizing…

Optimization and Control · Mathematics 2021-03-26 Isin M. Balci , Abhishek Halder , Efstathios Bakolas

We study optimization problems whereby the optimization variable is a probability measure. Since the probability space is not a vector space, many classical and powerful methods for optimization (e.g., gradients) are of little help. Thus,…

Optimization and Control · Mathematics 2024-06-18 Nicolas Lanzetti , Antonio Terpin , Florian Dörfler

We propose a fundamental metric for measuring the distance between two distributions. This metric, referred to as the decision-focused (DF) divergence, is tailored to stochastic linear optimization problems in which the objective…

Statistics Theory · Mathematics 2026-02-04 Suhan Liu , Mo Liu

In the past couple of years, various approaches to representing and quantifying different types of predictive uncertainty in machine learning, notably in the setting of classification, have been proposed on the basis of second-order…

Machine Learning · Computer Science 2023-12-05 Yusuf Sale , Viktor Bengs , Michele Caprio , Eyke Hüllermeier

Bin packing is an algorithmic problem that arises in diverse applications such as remnant inventory systems, shipping logistics, and appointment scheduling. In its simplest variant, a sequence of $T$ items (e.g., orders for raw material,…

Data Structures and Algorithms · Computer Science 2022-03-15 Varun Gupta , Ana Radovanovic

Distributionally robust control (DRC) aims to effectively manage distributional ambiguity in stochastic systems. While most existing works address inaccurate distributional information in fully observable settings, we consider a partially…

Systems and Control · Electrical Eng. & Systems 2022-12-23 Astghik Hakobyan , Insoon Yang

This paper proposes a distributionally robust approach to logistic regression. We use the Wasserstein distance to construct a ball in the space of probability distributions centered at the uniform distribution on the training samples. If…

Optimization and Control · Mathematics 2015-12-02 Soroosh Shafieezadeh-Abadeh , Peyman Mohajerin Esfahani , Daniel Kuhn

This paper investigates the robust optimal control of sampled-data stochastic systems with multiplicative noise and distributional ambiguity. We consider a class of discrete-time optimal control problems where the controller \emph{jointly}…

Optimization and Control · Mathematics 2026-02-05 Chung-Han Hsieh

We study the problem of estimating an unknown parameter in a distributed and online manner. Existing work on distributed online learning typically either focuses on asymptotic analysis, or provides bounds on regret. However, these results…

Systems and Control · Electrical Eng. & Systems 2022-09-15 Lei Xin , George Chiu , Shreyas Sundaram

We study online fair allocation of $T$ sequentially arriving items among $n$ agents with heterogeneous preferences, with the objective of maximizing generalized-mean welfare, defined as the $p$-mean of agents' time-averaged utilities, with…

Computer Science and Game Theory · Computer Science 2026-02-12 Zongjun Yang , Rachitesh Kumar , Christian Kroer