English
Related papers

Related papers: Robust $Q$-learning Algorithm for Markov Decision …

200 papers

We study control of constrained linear systems with only partial statistical information about the uncertainty affecting the system dynamics and the sensor measurements. Specifically, given a finite collection of disturbance realizations…

Optimization and Control · Mathematics 2024-07-15 Jean-Sébastien Brouillon , Andrea Martin , John Lygeros , Florian Dörfler , Giancarlo Ferrari Trecate

We study a variety of Wasserstein distributionally robust optimization (WDRO) problems where the distributions in the ambiguity set are chosen by constraining their Wasserstein discrepancies to the empirical distribution. Using the notion…

Optimization and Control · Mathematics 2024-02-07 Hong T. M. Chu , Meixia Lin , Kim-Chuan Toh

Distributionally robust optimization (DRO) is an effective approach for data-driven decision-making in the presence of uncertainty. Geometric uncertainty due to sampling or localized perturbations of data points is captured by Wasserstein…

Machine Learning · Statistics 2023-11-10 Sloan Nietert , Ziv Goldfeld , Soroosh Shafiee

Distributionally robust optimization (DRO) has become a powerful framework for estimation under uncertainty, offering strong out-of-sample performance and principled regularization. In this paper, we propose a DRO-based method for linear…

Machine Learning · Statistics 2025-05-06 Liviu Aolaritei , Soroosh Shafiee , Florian Dörfler

Off-policy evaluation and learning are concerned with assessing a given policy and learning an optimal policy from offline data without direct interaction with the environment. Often, the environment in which the data are collected differs…

Machine Learning · Computer Science 2024-01-18 Yi Shen , Pan Xu , Michael M. Zavlanos

We consider the challenge of finding a deterministic policy for a Markov decision process that uniformly (in all states) maximizes one reward subject to a probabilistic constraint over a different reward. Existing solutions do not fully…

Machine Learning · Computer Science 2022-01-21 Jaeyoung Lee , Sean Sedwards , Krzysztof Czarnecki

We consider the population Wasserstein barycenter problem for random probability measures supported on a finite set of points and generated by an online stream of data. This leads to a complicated stochastic optimization problem where the…

Optimization and Control · Mathematics 2021-12-06 Daniil Tiapkin , Alexander Gasnikov , Pavel Dvurechensky

We revisit Merton's continuous-time portfolio selection through a data-driven, distributionally robust lens. Our aim is to tap the benefits of frequent trading over short horizons while acknowledging that drift is hard to pin down, whereas…

Optimization and Control · Mathematics 2025-12-02 Jose Blanchet , Jiayi Cheng , Hao Liu , Yang Liu

We propose a distributionally robust data-driven predictive control framework for stochastic linear time-invariant systems with unknown dynamics and disturbance distributions. We use an offline trajectory to fit the subspace predictive…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Mirhan Urkmez , Shahab Heshmati-Alamdari

We consider settings in which the distribution of a multivariate random variable is partly ambiguous. We assume the ambiguity lies on the level of the dependence structure, and that the marginal distributions are known. Furthermore, a…

Mathematical Finance · Quantitative Finance 2020-05-27 Stephan Eckstein , Michael Kupper , Mathias Pohl

Transfer learning is a popular strategy to leverage external knowledge and improve statistical efficiency, particularly with a limited target sample. We propose a novel knowledge-guided Wasserstein Distributionally Robust Optimization…

Machine Learning · Computer Science 2025-02-13 Zitao Wang , Ziyuan Wang , Molei Liu , Nian Si

This paper considers a security constrained dispatch problem involving generation and line contingencies in the presence of the renewable generation. The uncertainty due to renewables is modeled using joint chance-constraint and the…

Optimization and Control · Mathematics 2022-08-17 Amin Maghami , Evrim Ursavas , Ashish Cherukuri

In this paper, we investigate distributionally robust model order reduction for linear, discrete-time, time-invariant systems. The external input is assumed to follow an uncertain distribution within a Wasserstein ambiguity set. We begin by…

Optimization and Control · Mathematics 2025-11-17 Le Liu , Yu Kawano , Yangming Dou , Ming Cao

We study distributionally robust optimization (DRO) problems with uncertainty sets consisting of high-dimensional random vectors that are close in the multivariate Wasserstein distance to a reference random vector. We give conditions when…

Optimization and Control · Mathematics 2026-01-30 Brandon Tam , Silvana M. Pesenti

To address the issue of inaccurate distributions in practical stochastic systems, a minimax linear-quadratic control method is proposed using the Wasserstein metric. Our method aims to construct a control policy that is robust against…

Systems and Control · Electrical Eng. & Systems 2021-02-26 Kihyun Kim , Insoon Yang

This paper studies two-stage distributionally robust conic linear programming under constraint uncertainty over type-1 Wasserstein balls. We present optimality conditions for the dual of the worst-case expectation problem, which…

Optimization and Control · Mathematics 2024-02-06 Geunyeong Byeon , Kaiwen Fang , Kibaek Kim

This paper presents a novel approach to addressing the distributionally robust nonlinear model predictive control (DRNMPC) problem. Current literature primarily focuses on the static Wasserstein distributionally robust optimal control…

Optimization and Control · Mathematics 2023-04-18 Zhengang Zhong , Jia-Jie Zhu

In recent years, Wasserstein Distributionally Robust Optimization (DRO) has garnered substantial interest for its efficacy in data-driven decision-making under distributional uncertainty. However, limited research has explored the…

Machine Learning · Computer Science 2025-10-01 Ahmad-Reza Ehyaei , Golnoosh Farnadi , Samira Samadi

In this work, we develop a novel data-driven Bayesian nonparametric Wasserstein distributionally robust optimization (BNWDRO) framework for decision-making under uncertainty. The proposed framework unifies a Bayesian nonparametric method…

Optimization and Control · Mathematics 2023-11-07 Chao Ning , Xutao Ma

We consider learning in an adversarial environment, where an $\varepsilon$-fraction of samples from a distribution $P$ are arbitrarily modified (global corruptions) and the remaining perturbations have average magnitude bounded by $\rho$…

Machine Learning · Computer Science 2024-06-26 Sloan Nietert , Ziv Goldfeld , Soroosh Shafiee