English
Related papers

Related papers: Reinforcement Learning with Wasserstein Distance R…

200 papers

The squared Wasserstein distance is a natural quantity to compare probability distributions in a non-parametric setting. This quantity is usually estimated with the plug-in estimator, defined via a discrete optimal transport problem which…

Optimization and Control · Mathematics 2020-10-30 Lenaic Chizat , Pierre Roussillon , Flavien Léger , François-Xavier Vialard , Gabriel Peyré

We address the problem of efficiently computing Wasserstein distances for multiple pairs of distributions drawn from a meta-distribution. To this end, we propose a fast estimation method based on regressing Wasserstein distance on sliced…

Machine Learning · Statistics 2026-03-04 Khai Nguyen , Hai Nguyen , Nhat Ho

In the study of dynamical and physical systems, the input parameters are often uncertain or randomly distributed according to a measure $\varrho$. The system's response $f$ pushes forward $\varrho$ to a new measure $f\circ \varrho$ which we…

Classical Analysis and ODEs · Mathematics 2019-11-15 Amir Sagiv

Deep metric learning employs deep neural networks to embed instances into a metric space such that distances between instances of the same class are small and distances between instances from different classes are large. In most existing…

Machine Learning · Computer Science 2019-12-05 Ahmed Abdelwahab , Niels Landwehr

Wasserstein distances are increasingly used in a wide variety of applications in machine learning. Sliced Wasserstein distances form an important subclass which may be estimated efficiently through one-dimensional sorting operations. In…

Machine Learning · Statistics 2019-04-08 Mark Rowland , Jiri Hron , Yunhao Tang , Krzysztof Choromanski , Tamas Sarlos , Adrian Weller

The effects of treatments are often heterogeneous, depending on the observable characteristics, and it is necessary to exploit such heterogeneity to devise individualized treatment rules (ITRs). Existing estimation methods of such ITRs…

Econometrics · Economics 2022-08-09 Daido Kido

Wasserstein distributionally robust optimization (DRO) has gained prominence in operations research and machine learning as a powerful method for achieving solutions with favorable out-of-sample performance. Two compelling explanations for…

Machine Learning · Computer Science 2024-12-23 Qinyu Wu , Jonathan Yu-Meng Li , Tiantian Mao

Off-policy evaluation and learning are concerned with assessing a given policy and learning an optimal policy from offline data without direct interaction with the environment. Often, the environment in which the data are collected differs…

Machine Learning · Computer Science 2024-01-18 Yi Shen , Pan Xu , Michael M. Zavlanos

The practical applications of Wasserstein distances (WDs) are constrained by their sample and computational complexities. Sliced-Wasserstein distances (SWDs) provide a workaround by projecting distributions onto one-dimensional subspaces,…

Machine Learning · Computer Science 2024-11-19 Huy Tran , Yikun Bai , Ashkan Shahbazi , John R. Hershey , Soheil Kolouri

We propose a methodology for intercomparing climate models and evaluating their performance against benchmarks based on the use of the Wasserstein distance (WD). This distance provides a rigorous way to measure quantitatively the difference…

Atmospheric and Oceanic Physics · Physics 2020-11-16 Gabriele Vissio , Valerio Lembo , Valerio Lucarini , Michael Ghil

This paper deals with the problem of learning a skill-conditioned policy that acts meaningfully in the absence of a reward signal. Mutual information based objectives have shown some success in learning skills that reach a diverse set of…

Machine Learning · Computer Science 2021-10-29 Ishan Durugkar , Steven Hansen , Stephen Spencer , Volodymyr Mnih

Imitation Learning describes the problem of recovering an expert policy from demonstrations. While inverse reinforcement learning approaches are known to be very sample-efficient in terms of expert demonstrations, they usually require…

Machine Learning · Computer Science 2019-06-20 Huang Xiao , Michael Herman , Joerg Wagner , Sebastian Ziesche , Jalal Etesami , Thai Hong Linh

Understanding the space of probability measures on a metric space equipped with a Wasserstein distance is one of the fundamental questions in mathematical analysis. The Wasserstein metric has received a lot of attention in the machine…

Machine Learning · Computer Science 2021-03-02 Arijit Sehanobish , Neal Ravindra , David van Dijk

We use adversarial network architectures together with the Wasserstein distance to generate or refine simulated detector data. The data reflect two-dimensional projections of spatially distributed signal patterns with a broad spectrum of…

Instrumentation and Methods for Astrophysics · Physics 2018-02-12 Martin Erdmann , Lukas Geiger , Jonas Glombitza , David Schmidt

Recently, a Wasserstein-type distance for Gaussian mixture models has been proposed. However, that framework can only be generalized to identifiable mixtures of general elliptically contoured distributions whose components come from the…

Optimization and Control · Mathematics 2025-03-19 Keyu Chen , Zetian Wang , Yunxin Zhang

Policy Mirror Descent (PMD) has emerged as a unifying framework in reinforcement learning (RL) by linking policy gradient methods with a first-order optimization method known as mirror descent. At its core, PMD incorporates two key…

Machine Learning · Computer Science 2025-07-14 Jan Felix Kleuker , Aske Plaat , Thomas Moerland

Word embeddings are high dimensional vector representations of words that capture their semantic similarity in the vector space. There exist several algorithms for learning such embeddings both for a single language as well as for several…

Computation and Language · Computer Science 2019-11-12 Georgios Balikas , Ioannis Partalas

The transfer of knowledge from one policy to another is an important tool in Deep Reinforcement Learning. This process, referred to as distillation, has been used to great success, for example, by enhancing the optimisation of agents,…

Distributionally robust optimization has emerged as an attractive way to train robust machine learning models, capturing data uncertainty and distribution shifts. Recent statistical analyses have proved that generalization guarantees of…

Optimization and Control · Mathematics 2025-01-28 Tam Le , Jérôme Malick

We propose regularization strategies for learning discriminative models that are robust to in-class variations of the input data. We use the Wasserstein-2 geometry to capture semantically meaningful neighborhoods in the space of images, and…

Machine Learning · Computer Science 2019-09-17 Alex Tong Lin , Yonatan Dukler , Wuchen Li , Guido Montufar