English
Related papers

Related papers: Don't Look Back in Anger: Wasserstein Distribution…

200 papers

Off-policy evaluation and learning are concerned with assessing a given policy and learning an optimal policy from offline data without direct interaction with the environment. Often, the environment in which the data are collected differs…

Machine Learning · Computer Science 2024-01-18 Yi Shen , Pan Xu , Michael M. Zavlanos

We study a distributionally robust mean square error estimation problem over a nonconvex Wasserstein ambiguity set containing only normal distributions. We show that the optimal estimator and the least favorable distribution form a Nash…

Optimization and Control · Mathematics 2018-10-02 Soroosh Shafieezadeh-Abadeh , Viet Anh Nguyen , Daniel Kuhn , Peyman Mohajerin Esfahani

Optimal transportation theory and the related $p$-Wasserstein distance ($W_p$, $p\geq 1$) are widely-applied in statistics and machine learning. In spite of their popularity, inference based on these tools has some issues. For instance, it…

Statistics Theory · Mathematics 2024-03-01 Yiming Ma , Hang Liu , Davide La Vecchia , Metthieu Lerasle

This paper presents a novel distribution-agnostic Wasserstein distance-based estimation framework. The goal is to determine an optimal map combining prior estimate with measurement likelihood such that posterior estimation error optimally…

Systems and Control · Electrical Eng. & Systems 2024-03-22 Himanshu Prabhat , Raktim Bhattacharya

Construction of ambiguity set in robust optimization relies on the choice of divergences between probability distributions. In distribution learning, choosing appropriate probability distributions based on observed data is critical for…

Machine Learning · Statistics 2017-05-24 Xin Guo , Johnny Hong , Nan Yang

This paper considers the problem of regression over distributions, which is becoming increasingly important in machine learning. Existing approaches often ignore the geometry of the probability space or are computationally expensive. To…

Machine Learning · Computer Science 2025-10-31 Maksim Maslov , Alexander Kugaevskikh , Matthew Ivanov

This paper presents a novel methodology for tractably solving optimal control and offline reinforcement learning problems for high-dimensional systems. This work is motivated by the ongoing challenges of safety, computation, and optimality…

Optimization and Control · Mathematics 2022-07-06 Aaron Kandel , Saehong Park , Scott Moura

Distributionally robust optimization (DRO)-based robust adaptive beamforming (RAB) enables enhanced robustness against model uncertainties, such as steering vector mismatches and interference-plus-noise covariance matrix estimation errors.…

Signal Processing · Electrical Eng. & Systems 2025-06-03 Kiarash Hassas Irani , Sergiy A. Vorobyov , Yongwei Huang

Wasserstein distributionally robust optimization (DRO) has gained prominence in operations research and machine learning as a powerful method for achieving solutions with favorable out-of-sample performance. Two compelling explanations for…

Machine Learning · Computer Science 2024-12-23 Qinyu Wu , Jonathan Yu-Meng Li , Tiantian Mao

We study the robust quickest change detection under unknown pre- and post-change distributions. To deal with uncertainties in the data-generating distributions, we formulate two data-driven ambiguity sets based on the Wasserstein distance,…

Statistics Theory · Mathematics 2022-04-28 Liyan Xie

Suppose we are given two metric spaces and a family of continuous transformations from one to the other. Given a probability distribution on each of these two spaces - namely the source and the target measures - the Wasserstein alignment…

Probability · Mathematics 2025-03-11 Soumik Pal , Bodhisattva Sen , Ting-Kam Leonard Wong

We propose a fundamental metric for measuring the distance between two distributions. This metric, referred to as the decision-focused (DF) divergence, is tailored to stochastic linear optimization problems in which the objective…

Statistics Theory · Mathematics 2026-02-04 Suhan Liu , Mo Liu

Data represented by probability measures arise as empirical distributions, posterior distributions, and feature-based representations of complex objects. We study heterogeneity in a population of probability measures through the expected…

Methodology · Statistics 2026-03-17 Kisung You

In the field of modern high-energy physics research, there is a growing emphasis on utilizing deep learning techniques to optimize event simulation, thereby expanding the statistical sample size for more accurate physical analysis.…

Computational Physics · Physics 2025-06-16 Chu-Cheng Pan , Xiang Dong , Yu-Chang Sun , Ao-Yan Cheng , Ao-Bo Wang , Yu-Xuan Hu , Hao Cai

Chance constraints yield non-convex feasible regions in general. In particular, when the uncertain parameters are modeled by a Wasserstein ball, arXiv:1806.07418 and arXiv:1809.00210 showed that the distributionally robust (pessimistic)…

Optimization and Control · Mathematics 2025-03-14 Haoming Shen , Ruiwei Jiang

In federated learning, participating clients typically possess non-i.i.d. data, posing a significant challenge to generalization to unseen distributions. To address this, we propose a Wasserstein distributionally robust optimization scheme…

Machine Learning · Computer Science 2022-06-06 Tung-Anh Nguyen , Tuan Dung Nguyen , Long Tan Le , Canh T. Dinh , Nguyen H. Tran

Neural networks are vulnerable to adversarial examples and researchers have proposed many heuristic attack and defense mechanisms. We address this problem through the principled lens of distributionally robust optimization, which guarantees…

Machine Learning · Statistics 2020-05-04 Aman Sinha , Hongseok Namkoong , Riccardo Volpi , John Duchi

We study sparse optimal control of a non-local continuity equation, where the goal is to steer a distribution via finitely many controllable agents or actuators. This model arises naturally in mean-field multi-agent systems and takes the…

Optimization and Control · Mathematics 2026-03-03 Enrico Sartor , Florian Dörfler , Nicolas Lanzetti

Distributional robustness is a promising framework for training deep learning models that are less vulnerable to adversarial examples and data distribution shifts. Previous works have mainly focused on exploiting distributional robustness…

Machine Learning · Computer Science 2023-11-02 Van-Anh Nguyen , Trung Le , Anh Tuan Bui , Thanh-Toan Do , Dinh Phung

Diffusion models are one of the most important families of deep generative models. In this note, we derive a quantitative upper bound on the Wasserstein distance between the data-generating distribution and the distribution learned by a…

Machine Learning · Computer Science 2024-09-17 Sokhna Diarra Mbacke , Omar Rivasplata