中文
相关论文

相关论文: Distributional Sliced-Wasserstein and Applications…

200 篇论文

Stochastic Gradient Descent (SGD) is one of the most widely used techniques for online optimization in machine learning. In this work, we accelerate SGD by adaptively learning how to sample the most useful training examples at each time…

机器学习 · 计算机科学 2016-03-16 Guillaume Bouchard , Théo Trouillon , Julien Perez , Adrien Gaidon

Wasserstein distance, which measures the discrepancy between distributions, shows efficacy in various types of natural language processing (NLP) and computer vision (CV) applications. One of the challenges in estimating Wasserstein distance…

机器学习 · 统计学 2022-06-27 Makoto Yamada , Yuki Takezawa , Ryoma Sato , Han Bao , Zornitsa Kozareva , Sujith Ravi

The Wasserstein distance is a metric on a space of probability measures that has seen a surge of applications in statistics, machine learning, and applied mathematics. However, statistical aspects of Wasserstein distances are bottlenecked…

概率论 · 数学 2022-03-02 Ziv Goldfeld , Kengo Kato , Sloan Nietert , Gabriel Rioux

This paper considers the fusion of multiple estimates of a spatially extended object, where the object extent is modeled as an ellipse parameterized by the orientation and semiaxes lengths. For this purpose, we propose a novel systematic…

信号处理 · 电气工程与系统科学 2019-10-09 Kolja Thormann , Marcus Baum

By building upon the recent theory that established the connection between implicit generative modeling (IGM) and optimal transport, in this study, we propose a novel parameter-free algorithm for learning the underlying distributions of…

Distributionally-robust optimization is often studied for a fixed set of distributions rather than time-varying distributions that can drift significantly over time (which is, for instance, the case in finance and sociology due to…

最优化与控制 · 数学 2020-10-01 Iman Shames , Farhad Farokhi

Wasserstein distance is a key metric for quantifying data divergence from a distributional perspective. However, its application in privacy-sensitive environments, where direct sharing of raw data is prohibited, presents significant…

机器学习 · 计算机科学 2025-02-04 Wenqian Li , Yan Pang

We develop a novel method for carrying out model selection for Bayesian autoencoders (BAEs) by means of prior hyper-parameter optimization. Inspired by the common practice of type-II maximum likelihood optimization and its equivalence to…

The Wasserstein distance, also known as the Earth mover distance or optimal transport distance, is a widely used measure of similarity between probability distributions. This paper presents an linear programming based implementation of the…

统计计算 · 统计学 2025-10-29 Zehao Lu

We study federated machine learning (ML) at the wireless edge, where power- and bandwidth-limited wireless devices with local datasets carry out distributed stochastic gradient descent (DSGD) with the help of a remote parameter server (PS).…

分布式、并行与集群计算 · 计算机科学 2020-04-08 Mohammad Mohammadi Amiri , Deniz Gunduz

Computing the similarity between two probability distributions is a recurring theme across control. We introduce a unified family of distances between the probability distributions of two random variables that is based on the discrepancy…

系统与控制 · 电气工程与系统科学 2025-10-03 Alexandros E. Tzikas , Arec Jamgochian , Nazim Kemal Ure , Mykel J. Kochenderfer , Stephen P. Boyd

Diffusion generative models have emerged as powerful tools for producing synthetic data from an empirically observed distribution. A common approach involves simulating the time-reversal of an Ornstein-Uhlenbeck (OU) process initialized at…

机器学习 · 统计学 2025-12-02 Valentin de Bortoli , Romuald Elie , Anna Kazeykina , Zhenjie Ren , Jiacheng Zhang

Learning algorithms for implicit generative models can optimize a variety of criteria that measure how the data distribution differs from the implicit model distribution, including the Wasserstein distance, the Energy distance, and the…

机器学习 · 统计学 2019-08-23 Leon Bottou , Martin Arjovsky , David Lopez-Paz , Maxime Oquab

In this paper we introduce a Wasserstein-type distance on the set of Gaussian mixture models. This distance is defined by restricting the set of possible coupling measures in the optimal transport problem to Gaussian mixture models. We…

最优化与控制 · 数学 2020-06-15 Julie Delon , Agnes Desolneux

We consider statistical methods which invoke a min-max distributionally robust formulation to extract good out-of-sample performance in data-driven optimization and learning problems. Acknowledging the distributional uncertainty in learning…

统计理论 · 数学 2021-08-05 Jose Blanchet , Karthyek Murthy , Viet Anh Nguyen

We study the problem of quantifying how far an empirical distribution deviates from Gaussianity under the framework of optimal transport. By exploiting the cone geometry of the relative translation invariant quadratic Wasserstein space, we…

机器学习 · 计算机科学 2026-02-02 Binshuai Wang , Peng Wei

We analyze a batched variant of Stochastic Gradient Descent (SGD) with weighted sampling distribution for smooth and non-smooth objective functions. We show that by distributing the batches computationally, a significant speedup in the…

数值分析 · 数学 2017-03-02 Deanna Needell , Rachel Ward

The Busemann function has recently found much interest in a variety of geometric machine learning problems, as it naturally defines projections onto geodesic rays of Riemannian manifolds and generalizes the notion of hyperplanes. As several…

机器学习 · 计算机科学 2026-03-13 Clément Bonet , Elsa Cazelles , Lucas Drumetz , Nicolas Courty

We address the problem of computing a textural loss based on the statistics extracted from the feature activations of a convolutional neural network optimized for object recognition (e.g. VGG-19). The underlying mathematical problem is the…

计算机视觉与模式识别 · 计算机科学 2021-03-12 Eric Heitz , Kenneth Vanhoey , Thomas Chambon , Laurent Belcour

The Wasserstein distance has emerged as a key metric to quantify distances between probability distributions, with applications in various fields, including machine learning, control theory, decision theory, and biological systems.…

机器学习 · 计算机科学 2026-02-10 Eduardo Figueiredo , Steven Adams , Luca Laurenti