English
Related papers

Related papers: Inference with Aggregate Data: An Optimal Transpor…

200 papers

The paper presents an iterative version of join-tree clustering that applies the message passing of join-tree clustering algorithm to join-graphs rather than to join-trees, iteratively. It is inspired by the success of Pearl's belief…

Artificial Intelligence · Computer Science 2013-01-07 Rina Dechter , Kalev Kask , Robert Mateescu

We study the problem of estimating latent population flows from aggregated count data. This problem arises when individual trajectories are not available due to privacy issues or measurement fidelity. Instead, the aggregated observations…

Machine Learning · Computer Science 2023-01-02 Sikun Yang , Hongyuan Zha

The current best practice for computing optimal transport (OT) is via entropy regularization and Sinkhorn iterations. This algorithm runs in quadratic time as it requires the full pairwise cost matrix, which is prohibitively expensive for…

Machine Learning · Computer Science 2022-04-06 Johannes Gasteiger , Marten Lienen , Stephan Günnemann

This article describes a set of methods for quickly computing the solution to the regularized optimal transport problem. It generalizes and improves upon the widely-used iterative Bregman projections algorithm (or Sinkhorn--Knopp…

Numerical Analysis · Mathematics 2021-04-02 Alexis Thibault , Lénaïc Chizat , Charles Dossal , Nicolas Papadakis

Gaussian belief propagation (GaBP) is an iterative message-passing algorithm for inference in Gaussian graphical models. It is known that when GaBP converges it converges to the correct MAP estimate of the Gaussian random vector and simple…

Information Theory · Computer Science 2010-03-23 Jason K. Johnson , Danny Bickson , Danny Dolev

We consider the task of aggregating beliefs of severalexperts. We assume that these beliefs are represented as probabilitydistributions. We argue that the evaluation of any aggregationtechnique depends on the semantic context of this task.…

Artificial Intelligence · Computer Science 2013-01-14 Pedrito Maynard-Reid , Urszula Chajewska

We present a novel inference algorithm for arbitrary, binary, undirected graphs. Unlike loopy belief propagation, which iterates fixed point equations, we directly descend on the Bethe free energy. The algorithm consists of two phases,…

Artificial Intelligence · Computer Science 2013-01-14 Max Welling , Yee Whye Teh

Tensor network contraction is a fundamental computational challenge underlying quantum many-body physics, statistical mechanics, and machine learning. Belief propagation (BP) provides an efficient approximate solution, but introduces…

Optimal transport (OT) theory focuses, among all maps $T:\mathbb{R}^d\rightarrow \mathbb{R}^d$ that can morph a probability measure onto another, on those that are the ``thriftiest'', i.e. such that the averaged cost $c(x, T(x))$ between…

Machine Learning · Statistics 2023-02-09 Marco Cuturi , Michal Klein , Pierre Ablin

Belief Propagation (BP) is an important message-passing algorithm for various reasoning tasks over graphical models, including solving the Constraint Optimization Problems (COPs). It has been shown that BP can achieve state-of-the-art…

Artificial Intelligence · Computer Science 2022-09-27 Yanchen Deng , Shufeng Kong , Caihua Liu , Bo An

Belief propagation is a widely used message passing method for the solution of probabilistic models on networks such as epidemic models, spin models, and Bayesian graphical models, but it suffers from the serious shortcoming that it works…

Statistical Mechanics · Physics 2021-04-27 Alec Kirkley , George T. Cantwell , M. E. J. Newman

In this paper, we propose the optimal production transport model, which is an extension of the classical optimal transport model. We observe in economics, the production of the factories can always be adjusted within a certain range, while…

Optimization and Control · Mathematics 2025-07-02 Jie Fan , Tianhao Wu , Hao Wu

The objective in statistical Optimal Transport (OT) is to consistently estimate the optimal transport plan/map solely using samples from the given source and target marginal distributions. This work takes the novel approach of posing…

Machine Learning · Computer Science 2020-11-11 J. Saketha Nath , Pratik Jawanpuria

Graph neural networks (GNNs) have exhibited exceptional efficacy in a diverse array of applications. However, the sheer size of large-scale graphs presents a significant challenge to real-time inference with GNNs. Although existing Scalable…

Machine Learning · Computer Science 2023-12-13 Xinyi Gao , Wentao Zhang , Junliang Yu , Yingxia Shao , Quoc Viet Hung Nguyen , Bin Cui , Hongzhi Yin

We present a novel framework based on optimal transport for the challenging problem of comparing graphs. Specifically, we exploit the probabilistic distribution of smooth graph signals defined with respect to the graph topology. This allows…

Machine Learning · Computer Science 2019-12-09 Hermina Petric Maretic , Mireille EL Gheche , Giovanni Chierchia , Pascal Frossard

We propose consensus propagation, an asynchronous distributed protocol for averaging numbers across a network. We establish convergence, characterize the convergence rate for regular graphs, and demonstrate that the protocol exhibits better…

Information Theory · Computer Science 2007-07-13 Ciamac C. Moallemi , Benjamin Van Roy

Sinkhorn algorithm has been used pervasively to approximate the solution to optimal transport (OT) and unbalanced optimal transport (UOT) problems. However, its practical application is limited due to the high computational complexity. To…

Machine Learning · Statistics 2026-04-07 Mengyu Li , Jun Yu , Tao Li , Cheng Meng

Gaussian belief propagation (BP) is a computationally efficient method to approximate the marginal distribution and has been widely used for inference with high dimensional data as well as distributed estimation in large-scale networks.…

Information Theory · Computer Science 2017-11-29 Jian Du , Soummya Kar , José M. F. Moura

We study the complexity of approximating the multimarginal optimal transport (MOT) distance, a generalization of the classical optimal transport distance, considered here between $m$ discrete probability distributions supported each on $n$…

Machine Learning · Statistics 2022-02-23 Tianyi Lin , Nhat Ho , Marco Cuturi , Michael I. Jordan

We derive iterative scaling algorithms of the Sinkhorn-Knopp (SK) type for constrained optimal transport. The constraints are in the form of prior-imposed zeroes in the transport plan. Based on classical Bregman arguments, we prove…

Optimization and Control · Mathematics 2024-04-02 Martin Corless , Anthony Quinn , Sarah Boufelja , Robert Shorten