English
Related papers

Related papers: Minimizing $f$-Divergences by Interpolating Veloci…

200 papers

Although Potent purports to use only radial velocities in reconstructing the potential velocity field of galaxies, the derivation of transverse components is implicit in the smoothing procedures adopted. Thus the possibility arises of using…

Astrophysics · Physics 2007-05-23 J. F. L. Simmons , A. Newsam , M. A. Hendry

We introduce a novel optimal transport framework for probabilistic circuits (PCs). While it has been shown recently that divergences between distributions represented as certain classes of PCs can be computed tractably, to the best of our…

Artificial Intelligence · Computer Science 2025-10-16 Adrian Ciotinga , YooJung Choi

Parameter estimation is a fundamental challenge in machine learning, crucial for tasks such as neural network weight fitting and Bayesian inference. This paper focuses on the complexity of estimating translation $\boldsymbol{\mu} \in…

Machine Learning · Computer Science 2025-01-20 Valentio Iverson , Stephen Vavasis

This paper presents a novel distribution-agnostic Wasserstein distance-based estimation framework. The goal is to determine an optimal map combining prior estimate with measurement likelihood such that posterior estimation error optimally…

Systems and Control · Electrical Eng. & Systems 2024-03-22 Himanshu Prabhat , Raktim Bhattacharya

The performance of machine learning (ML) models critically depends on the quality and representativeness of the training data. In applications with multiple heterogeneous data generating sources, standard ML methods often learn spurious…

Minimizing functionals in the space of probability distributions can be done with Wasserstein gradient flows. To solve them numerically, a possible approach is to rely on the Jordan-Kinderlehrer-Otto (JKO) scheme which is analogous to the…

Machine Learning · Computer Science 2022-11-16 Clément Bonet , Nicolas Courty , François Septier , Lucas Drumetz

This paper contains two contributions in the study of optimal transport on metric graphs. Firstly, we prove a Benamou-Brenier formula for the Wasserstein distance, which establishes the equivalence of static and dynamical optimal transport.…

Analysis of PDEs · Mathematics 2022-05-02 Matthias Erbar , Dominik Forkert , Jan Maas , Delio Mugnolo

Diffusion models have revolutionized various application domains, including computer vision and audio generation. Despite the state-of-the-art performance, diffusion models are known for their slow sample generation due to the extensive…

Machine Learning · Computer Science 2024-06-25 Zehao Dou , Minshuo Chen , Mengdi Wang , Zhuoran Yang

Determinantal point processes (DPPs) have received significant attention as an elegant probabilistic model for discrete subset selection. Most prior work on DPP learning focuses on maximum likelihood estimation (MLE). While efficient and…

Machine Learning · Computer Science 2020-11-20 Lucas Anquetil , Mike Gartrell , Alain Rakotomamonjy , Ugo Tanielian , Clément Calauzènes

Minimizing a convex function of a measure with a sparsity-inducing penalty is a typical problem arising, e.g., in sparse spikes deconvolution or two-layer neural networks training. We show that this problem can be solved by discretizing the…

Optimization and Control · Mathematics 2020-11-04 Lenaic Chizat

Many decision problems in science, engineering and economics are affected by uncertain parameters whose distribution is only indirectly observable through samples. The goal of data-driven decision-making is to learn a decision from finitely…

Machine Learning · Statistics 2024-11-05 Daniel Kuhn , Peyman Mohajerin Esfahani , Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh

The $E$-optimality criterion for a regression model maximizes the smallest eigenvalue of the information matrix and becomes non-differentiable when this eigenvalue has multiplicity greater than one. Working in the $2$-Wasserstein space, we…

Optimization and Control · Mathematics 2026-04-17 Jieling Shi , Kim-Chuan Toh , Xin T. Tong , Weng Kee Wong

The purpose of this paper is to answer a few open questions in the interface of kernel methods and PDE gradient flows. Motivated by recent advances in machine learning, particularly in generative modeling and sampling, we present a rigorous…

Machine Learning · Statistics 2024-10-29 Jia-Jie Zhu , Alexander Mielke

In this paper, we consider the problem of propagating an uncertain distribution by a possibly non-linear function and quantifying the resulting uncertainty. We measure the uncertainty using the Wasserstein distance, and for a given input…

Systems and Control · Electrical Eng. & Systems 2025-06-13 Eduardo Figueiredo , Steven Adams , Peyman Mohajerin Esfahani , Luca Laurenti

Neural ordinary differential equations (ODEs) provide expressive representations of invertible transport maps that can be used to approximate complex probability distributions, e.g., for generative modeling, density estimation, and Bayesian…

Machine Learning · Computer Science 2025-02-07 Youssef Marzouk , Zhi Ren , Jakob Zech

Wasserstein gradient flows on probability measures have found a host of applications in various optimization problems. They typically arise as the continuum limit of exchangeable particle systems evolving by some mean-field interaction…

Probability · Mathematics 2023-06-30 Sewoong Oh , Soumik Pal , Raghav Somani , Raghavendra Tripathi

We propose a novel approach to the problem of multilevel clustering, which aims to simultaneously partition data in each group and discover grouping patterns among groups in a potentially large hierarchically structured corpus of data. Our…

Machine Learning · Statistics 2021-05-26 Viet Huynh , Nhat Ho , Nhan Dam , XuanLong Nguyen , Mikhail Yurochkin , Hung Bui , and Dinh Phung

Graph generation has emerged as a critical task in fields ranging from drug discovery to circuit design. Contemporary approaches, notably diffusion and flow-based models, have achieved solid graph generative performance through constructing…

Machine Learning · Computer Science 2026-03-06 Keyue Jiang , Jiahao Cui , Xiaowen Dong , Laura Toni

We formulate a class of velocity-free finite-particle methods for mass transport problems based on a time-discrete incremental variational principle that combines entropy and the cost of particle transport, as measured by the Wasserstein…

Computational Physics · Physics 2023-05-10 Anna Pandolfi , Laurent Stainier , Michael Ortiz

A generative model based on a continuous-time normalizing flow between any pair of base and target probability densities is proposed. The velocity field of this flow is inferred from the probability current of a time-dependent density that…

Machine Learning · Computer Science 2023-03-10 Michael S. Albergo , Eric Vanden-Eijnden