English
Related papers

Related papers: Ambiguity set and learning via Bregman and Wassers…

200 papers

Information divergence that measures the difference between two nonnegative matrices or tensors has found its use in a variety of machine learning problems. Examples are Nonnegative Matrix/Tensor Factorization, Stochastic Neighbor…

Machine Learning · Computer Science 2014-06-06 Onur Dikmen , Zhirong Yang , Erkki Oja

Stochastic programs where the uncertainty distribution must be inferred from noisy data samples are considered. The stochastic programs are approximated with distributionally-robust optimizations that minimize the worst-case expected cost…

Optimization and Control · Mathematics 2024-01-04 Farhad Farokhi

We present a provably safe sampling-based motion planning algorithm for robotic systems affected by random disturbances of unknown distribution. We consider systems with linear or linearizable dynamics evolving in workspace with…

Robotics · Computer Science 2026-05-27 Ibon Gracia , Qi Heng Ho , Luca Laurenti , Morteza Lahijanian

Precise control under uncertainty requires a good understanding and characterization of the noise affecting the system. This paper studies the problem of steering state distributions of dynamical systems subject to partially known…

Optimization and Control · Mathematics 2024-03-20 Joshua Pilipovsky , Panagiotis Tsiotras

This paper studies the expected optimal value of a mixed 0-1 programming problem with uncertain objective coefficients following a joint distribution. We assume that the true distribution is not known exactly, but a set of independent…

Optimization and Control · Mathematics 2017-08-28 Guanglin Xu , Samuel Burer

Structuring ambiguity sets in Wasserstein-based distributionally robust optimization (DRO) can improve their statistical properties when the uncertainty consists of multiple independent components. The aim of this paper is to solve…

Optimization and Control · Mathematics 2025-04-10 Lotfi M. Chaouach , Tom Oomen , Dimitris Boskos

The Wasserstein distance, rooted in optimal transport (OT) theory, is a popular discrepancy measure between probability distributions with various applications to statistics and machine learning. Despite their rich structure and…

Machine Learning · Statistics 2023-03-02 Sloan Nietert , Rachel Cummings , Ziv Goldfeld

Classical linear metric learning methods have recently been extended along two distinct lines: deep metric learning methods for learning embeddings of the data using neural networks, and Bregman divergence learning approaches for extending…

Machine Learning · Computer Science 2020-05-07 Kubra Cilingir , Rachel Manzelli , Brian Kulis

Comparing probability distributions is at the crux of many machine learning algorithms. Maximum Mean Discrepancies (MMD) and Wasserstein distances are two classes of distances between probability distributions that have attracted abundant…

Machine Learning · Statistics 2023-06-01 Titouan Vayer , Rémi Gribonval

This paper addresses a new active learning strategy for regression problems. The presented Wasserstein active regression model is based on the principles of distribution-matching to measure the representativeness of the labeled dataset. The…

Machine Learning · Computer Science 2024-03-25 Benjamin Bobbia , Matthias Picard

In this work, we study how to ensure probabilistic safety for nonlinear systems under distributional ambiguity. Our approach builds on a backup-based safety filtering framework that switches between a high-performance nominal policy and a…

Robotics · Computer Science 2026-05-20 Daniel M. Cherenson , Haejoon Lee , Taekyung Kim , Dimitra Panagou

We consider robust variants of the standard optimal transport, named robust optimal transport, where marginal constraints are relaxed via Kullback-Leibler divergence. We show that Sinkhorn-based algorithms can approximate the optimal cost…

Machine Learning · Computer Science 2021-10-29 Khang Le , Huy Nguyen , Quang Nguyen , Tung Pham , Hung Bui , Nhat Ho

The discrete distribution is often used to describe complex instances in machine learning, such as images, sequences, and documents. Traditionally, clustering of discrete distributions (D2C) has been approached using Wasserstein barycenter…

Machine Learning · Computer Science 2024-08-19 Zixiao Wang , Dong Qiao , Jicong Fan

Unsupervised learning of disentangled representations involves uncovering of different factors of variations that contribute to the data generation process. Total correlation penalization has been a key component in recent methods towards…

Machine Learning · Computer Science 2020-01-01 Yijun Xiao , William Yang Wang

We propose a new unsupervised anomaly detection method based on the sliced-Wasserstein distance for training data selection in machine learning approaches. Our filtering technique is interesting for decision-making pipelines deploying…

Machine Learning · Computer Science 2025-04-18 Julien Pallage , Antoine Lesage-Landry

A loss function measures the discrepancy between the true values and their estimated fits, for a given instance of data. In classification problems, a loss function is said to be proper if a minimizer of the expected loss is the true…

Information Theory · Computer Science 2020-01-03 Amichai Painsky , Gregory W. Wornell

Wasserstein distributionally robust optimization offers a framework for model fitting in machine learning under potential shifts in the data distribution. We study a regularized variant of this problem in which entropic smoothing produces a…

Optimization and Control · Mathematics 2026-05-28 Tam Le

This paper considers the problem of regression over distributions, which is becoming increasingly important in machine learning. Existing approaches often ignore the geometry of the probability space or are computationally expensive. To…

Machine Learning · Computer Science 2025-10-31 Maksim Maslov , Alexander Kugaevskikh , Matthew Ivanov

In this paper, we propose a novel robust stochastic optimization approach with a distinctive consideration for rare events, in which divergence measures are used to bound the event-wise ambiguity sets. This is done by using the Poisson…

Optimization and Control · Mathematics 2021-09-14 Aakil M. Caunhye , Douglas Alem

Building on a recent framework for distributionally robust optimization, we consider estimation of the inverse covariance matrix for multivariate data. We provide a novel notion of a Wasserstein ambiguity set specifically tailored to this…

Machine Learning · Statistics 2019-10-08 Pedro Cisneros-Velarde , Sang-Yun Oh , Alexander Petersen
‹ Prev 1 3 4 5 6 7 10 Next ›