中文
相关论文

相关论文: Mutual Wasserstein Discrepancy Minimization for Se…

200 篇论文

We introduce a distortion measure for images, Wasserstein distortion, that simultaneously generalizes pixel-level fidelity on the one hand and realism or perceptual quality on the other. We show how Wasserstein distortion reduces to a pure…

信息论 · 计算机科学 2024-04-01 Yang Qiu , Aaron B. Wagner , Johannes Ballé , Lucas Theis

Wasserstein distance is a key metric for quantifying data divergence from a distributional perspective. However, its application in privacy-sensitive environments, where direct sharing of raw data is prohibited, presents significant…

机器学习 · 计算机科学 2025-02-04 Wenqian Li , Yan Pang

Feature selection and reducing the dimensionality of data is an essential step in data analysis. In this work, we propose a new criterion for feature selection that is formulated as conditional information between features given the labeled…

机器学习 · 统计学 2019-05-20 Salimeh Yasaei Sekeh , Alfred O. Hero

This paper deals with clustering methods based on adaptive distances for histogram data using a dynamic clustering algorithm. Histogram data describes individuals in terms of empirical distributions. These kind of data can be considered as…

统计理论 · 数学 2016-05-03 Antonio Irpino , Rosanna Verde , Francisco de AT De Carvalho

To measure the similarity of documents, the Wasserstein distance is a powerful tool, but it requires a high computational cost. Recently, for fast computation of the Wasserstein distance, methods for approximating the Wasserstein distance…

机器学习 · 计算机科学 2021-07-26 Yuki Takezawa , Ryoma Sato , Makoto Yamada

Robust optimization is a tractable and expressive technique for decision-making under uncertainty, but it can lead to overly conservative decisions when pessimistic assumptions are made on the uncertain parameters. Wasserstein…

最优化与控制 · 数学 2026-04-07 Irina Wang , Cole Becker , Bart Van Parys , Bartolomeo Stellato

In this paper, we study the problem of sampling from a distribution under the constraint of differential privacy (DP). Prior works measure the utility of DP sampling with density ratio-based measures such as KL divergence. However, such…

机器学习 · 统计学 2026-05-12 Shokichi Takakura , Seng Pei Liew , Satoshi Hasegawa

When maximum likelihood estimation is infeasible, one often turns to score matching, contrastive divergence, or minimum probability flow to obtain tractable parameter estimates. We provide a unifying perspective of these techniques as…

Among dissimilarities between probability distributions, the Kernel Stein Discrepancy (KSD) has received much interest recently. We investigate the properties of its Wasserstein gradient flow to approximate a target probability distribution…

机器学习 · 统计学 2021-05-24 Anna Korba , Pierre-Cyril Aubin-Frankowski , Szymon Majewski , Pierre Ablin

Mutual information $I(X;Y)$ is a useful definition in information theory to estimate how much information the random variable $Y$ holds about the random variable $X$. One way to define the mutual information is by comparing the joint…

信息论 · 计算机科学 2022-04-14 Bulut Kuskonmaz , Jaron Skovsted Gundersen , Rafal Wisniewski

Bayesian optimal experimental design (OED) provides a principled framework for selecting observations or experiments. We introduce new Bayesian design criteria based on the expected Wasserstein-$p$ distance between the prior and posterior…

统计方法学 · 统计学 2026-05-28 Tapio Helin , Youssef Marzouk , Jose Rodrigo Rojo-Garcia

Deep metric learning employs deep neural networks to embed instances into a metric space such that distances between instances of the same class are small and distances between instances from different classes are large. In most existing…

机器学习 · 计算机科学 2019-12-05 Ahmed Abdelwahab , Niels Landwehr

The paper studies the robustness properties of discrete-time stochastic optimal control under Wasserstein model approximation for both discounted-cost and average-cost criteria. Specifically, we study the performance loss when applying an…

系统与控制 · 电气工程与系统科学 2026-03-10 Yichen Zhou , Yanglei Song , Serdar Yüksel

Wasserstein distances are increasingly used in a wide variety of applications in machine learning. Sliced Wasserstein distances form an important subclass which may be estimated efficiently through one-dimensional sorting operations. In…

机器学习 · 统计学 2019-04-08 Mark Rowland , Jiri Hron , Yunhao Tang , Krzysztof Choromanski , Tamas Sarlos , Adrian Weller

The subject of this paper is the estimation of a probability measure on ${\mathbb R}^d$ from data observed with an additive noise, under the Wasserstein metric of order $p$ (with $p\geq 1$). We assume that the distribution of the errors is…

统计理论 · 数学 2013-07-22 Jérôme Dedecker , Bertrand Michel

Distances between probability distributions are a key component of many statistical machine learning tasks, from two-sample testing to generative modeling, among others. We introduce a novel distance between measures that compares them…

机器学习 · 统计学 2025-07-09 Arturo Castellanos , Anna Korba , Pavlo Mozharovskyi , Hicham Janati

The quantum Wasserstein distance (W-distance) is a fundamental metric for quantifying the distinguishability of quantum operations, with critical applications in quantum error correction. However, computing the W-distance remains…

量子物理 · 物理学 2025-11-18 Changchun Feng , Xinyu Qiu , Laifa Tao , Lin Chen

Recently, a method called the Mutual Information Neural Estimator (MINE) that uses neural networks has been proposed to estimate mutual information and more generally the Kullback-Leibler (KL) divergence between two distributions. The…

机器学习 · 计算机科学 2019-08-20 Kartik Ahuja

This paper presents a novel distribution-agnostic Wasserstein distance-based estimation framework. The goal is to determine an optimal map combining prior estimate with measurement likelihood such that posterior estimation error optimally…

系统与控制 · 电气工程与系统科学 2024-03-22 Himanshu Prabhat , Raktim Bhattacharya

We address the challenge of sequential data-driven decision-making under context distributional uncertainty. This problem arises in numerous real-world scenarios where the learner optimizes black-box objective functions in the presence of…

机器学习 · 计算机科学 2025-03-27 Francesco Micheli , Efe C. Balta , Anastasios Tsiamis , John Lygeros