English
Related papers

Related papers: Inference with Aggregate Data: An Optimal Transpor…

200 papers

During recent decades, there has been a substantial development in optimal mass transport theory and methods. In this work, we consider multi-marginal problems wherein only partial information of each marginal is available, which is a setup…

Signal Processing · Electrical Eng. & Systems 2019-05-13 Filip Elvander , Isabel Haasler , Andreas Jakobsson , Johan Karlsson

Belief propagation is a well-studied algorithm for approximating local marginals of multivariate probability distribution over complex networks, while tensor network states are powerful tools for quantum and classical many-body problems.…

Quantum Physics · Physics 2023-09-08 Chu Guo , Dario Poletti , Itai Arad

We propose an entropic approximation approach for optimal transportation problems with a supremal cost. We establish $\Gamma$-convergence for suitably chosen parameters for the entropic penalization and that this procedure selects…

Analysis of PDEs · Mathematics 2023-02-24 Guillaume Carlier , Camilla Brizzi , Luigi De Pascale

In this paper, we propose an algorithm for estimating the parameters of a time-homogeneous hidden Markov model from aggregate observations. This problem arises when only the population level counts of the number of individuals at each time…

Machine Learning · Computer Science 2021-11-16 Rahul Singh , Qinsheng Zhang , Yongxin Chen

We study multi-marginal optimal transport problems from a probabilistic graphical model perspective. We point out an elegant connection between the two when the underlying cost for optimal transport allows a graph structure. In particular,…

Optimization and Control · Mathematics 2020-06-26 Isabel Haasler , Rahul Singh , Qinsheng Zhang , Johan Karlsson , Yongxin Chen

We derive limit distributions for certain empirical regularized optimal transport distances between probability distributions supported on a finite metric space and show consistency of the (naive) bootstrap. In particular, we prove that the…

Statistics Theory · Mathematics 2019-05-02 Marcel Klatt , Carla Tameling , Axel Munk

The notion of entropy-regularized optimal transport, also known as Sinkhorn divergence, has recently gained popularity in machine learning and statistics, as it makes feasible the use of smoothed optimal transportation distances for data…

Statistics Theory · Mathematics 2019-11-05 Jérémie Bigot , Elsa Cazelles , Nicolas Papadakis

This paper is devoted to the stochastic approximation of entropically regularized Wasserstein distances between two probability measures, also known as Sinkhorn divergences. The semi-dual formulation of such regularized optimal…

Statistics Theory · Mathematics 2024-12-10 Bernard Bercu , Jérémie Bigot

In this paper, we tackle the transductive semi-supervised learning problem that aims to obtain label predictions for the given unlabeled data points according to Vapnik's principle. Our proposed approach is based on optimal transport, a…

Machine Learning · Computer Science 2021-10-05 Mourad El Hamri , Younès Bennani , Issam Falih

Optimal transport (OT) distances are finding evermore applications in machine learning and computer vision, but their wide spread use in larger-scale problems is impeded by their high computational cost. In this work we develop a family of…

Machine Learning · Statistics 2018-03-06 Brahim Khalil Abid , Robert M. Gower

This paper exploit the equivalence between the Schr\"odinger Bridge problem and the entropy penalized optimal transport in order to find a different approach to the duality, in the spirit of optimal transport. This approach results in a…

Probability · Mathematics 2019-11-19 Simone Di Marino , Augusto Gerolin

Optimal transportation theory and the related $p$-Wasserstein distance ($W_p$, $p\geq 1$) are widely-applied in statistics and machine learning. In spite of their popularity, inference based on these tools has some issues. For instance, it…

Statistics Theory · Mathematics 2024-03-01 Yiming Ma , Hang Liu , Davide La Vecchia , Metthieu Lerasle

There is an increasing interest in scaling tensor network methods through belief propagation (BP), as well as increasing the accuracy of BP through tensor network methods. We develop a unification framework that takes an arbitrary graphical…

Quantum Physics · Physics 2025-11-25 Pedro Hack , Jonas Hitter , Christian B. Mendl , Alexandru Paler

Belief Propagation algorithms are instruments used broadly to solve graphical model optimization and statistical inference problems. In the general case of a loopy Graphical Model, Belief Propagation is a heuristic which is quite successful…

Machine Learning · Statistics 2021-09-15 Andrii Riazanov , Yury Maximov , Michael Chertkov

Belief propagation (BP) is a powerful tool to solve distributed inference problems, though it is limited by short cycles in the corresponding factor graph. Such cycles may lead to incorrect solutions or oscillatory behavior. Only for…

Systems and Control · Computer Science 2018-02-08 Christopher Lindberg , Julien M. Hendrickx , Henk Wymeersch

The sum-product or belief propagation (BP) algorithm is a widely-used message-passing algorithm for computing marginal distributions in graphical models with discrete variables. At the core of the BP message updates, when applied to a…

Information Theory · Computer Science 2012-05-28 Nima Noorshams , Martin J. Wainwright

A common network inference problem, arising from real-world data constraints, is how to infer a dynamic network from its time-aggregated adjacency matrix and time-varying marginals (i.e., row and column sums). Prior approaches to this…

Machine Learning · Statistics 2024-08-21 Serina Chang , Frederic Koehler , Zhaonan Qu , Jure Leskovec , Johan Ugander

We address the problem of uncertainty propagation in the discrete Fourier transform by modeling the fast Fourier transform as a factor graph. Building on this representation, we propose an efficient framework for approximate Bayesian…

Machine Learning · Computer Science 2025-06-09 Luca Schmid , Charlotte Muth , Laurent Schmalen

We perform theoretical and algorithmic studies for the problem of clustering and semi-supervised classification on graphs with both pairwise relational information and single-point feature information, upon a joint stochastic block model…

Statistical Mechanics · Physics 2020-09-02 Pengfei Zhou , Tianyi Li , Pan Zhang

A fundamental computation for statistical inference and accurate decision-making is to compute the marginal probabilities or most probable states of task-relevant variables. Probabilistic graphical models can efficiently represent the…

Machine Learning · Computer Science 2019-06-28 KiJung Yoon , Renjie Liao , Yuwen Xiong , Lisa Zhang , Ethan Fetaya , Raquel Urtasun , Richard Zemel , Xaq Pitkow