English
Related papers

Related papers: Wide Consensus for Parallelized Inference

200 papers

Wasserstein barycenters have become popular due to their ability to represent the average of probability measures in a geometrically meaningful way. In this paper, we present an algorithm to approximate the Wasserstein-2 barycenters of…

Machine Learning · Computer Science 2023-01-10 Alexander Korotin , Vage Egiazarian , Lingxiao Li , Evgeny Burnaev

We consider the problem of computing a Wasserstein barycenter for a set of discrete probability distributions with finite supports, which finds many applications in areas such as statistics, machine learning and image processing. When the…

Optimization and Control · Mathematics 2020-12-29 Lei Yang , Jia Li , Defeng Sun , Kim-Chuan Toh

We provide upper bounds of the expected Wasserstein distance between a probability measure and its empirical version, generalizing recent results for finite dimensional Euclidean spaces and bounded functional spaces. Such a generalization…

Statistics Theory · Mathematics 2020-01-29 Jing Lei

This article studies a general divide-and-conquer algorithm for approximating continuous one-dimensional probability distributions with finite mean. The article presents a numerical study that compares pre-existing approximation schemes…

We present the Bayesian consensus filter (BCF) for tracking a moving target using a networked group of sensing agents and achieving consensus on the best estimate of the probability distributions of the target's states. Our BCF framework…

Optimization and Control · Mathematics 2016-10-14 Saptarshi Bandyopadhyay , Soon-Jo Chung

We propose a general method for distributed Bayesian model choice, using the marginal likelihood, where a data set is split in non-overlapping subsets. These subsets are only accessed locally by individual workers and no data is shared…

Computation · Statistics 2022-10-18 Alexander Buchholz , Daniel Ahfock , Sylvia Richardson

In this work we study systems consisting of a group of moving particles. In such systems, often some important parameters are unknown and have to be estimated from observed data. Such parameter estimation problems can often be solved via a…

Applications · Statistics 2023-07-11 Chen Cheng , Linjie Wen , Jinglai Li

We propose a distributed method for simultaneous inference for datasets with sample size much larger than the number of covariates, i.e., N >> p, in the generalized linear models framework. When such datasets are too big to be analyzed…

Methodology · Statistics 2020-07-23 Lu Tang , Ling Zhou , Peter X. -K. Song

This paper is concerned by the study of barycenters for random probability measures in the Wasserstein space. Using a duality argument, we give a precise characterization of the population barycenter for various parametric classes of random…

Statistics Theory · Mathematics 2017-11-30 Jérémie Bigot , Thierry Klein

We consider \emph{plurality consensus} in a network of $n$ nodes. Initially, each node has one of $k$ opinions. The nodes execute a (randomized) distributed protocol to agree on the plurality opinion (the opinion initially supported by the…

Data Structures and Algorithms · Computer Science 2016-02-04 Petra Berenbrink , Tom Friedetzky , Peter Kling , Frederik Mallmann-Trenn , Chris Wastell

In this paper the elicitation of probabilities from human experts is considered as a measurement process, which may be disturbed by random 'measurement noise'. Using Bayesian concepts a second order probability distribution is derived…

Artificial Intelligence · Computer Science 2013-04-05 Gerhard Paaß

We present new algorithms to compute the mean of a set of empirical probability measures under the optimal transport metric. This mean, known as the Wasserstein barycenter, is the measure that minimizes the sum of its Wasserstein distances…

Machine Learning · Statistics 2014-06-18 Marco Cuturi , Arnaud Doucet

Ensemble forecasts and their combination are examined from the perspective of probability spaces. Manipulating ensemble forecasts as discrete probability distributions, multi-model ensemble (MME) forecasts are reformulated as barycenters of…

Applications · Statistics 2025-03-24 Camille Le Coz , Alexis Tantet , Rémi Flamary , Riwal Plougonven

Combining data has become an indispensable tool for managing the current diversity and abundance of data. But, as data complexity and data volume swell, the computational demands of previously proposed models for combining data escalate…

Methodology · Statistics 2024-06-13 Mario Figueira , David Conesa , Antonio López-Quílez , Iosu Paradinas

Wasserstein barycenters provide a principled approach for aggregating probability measures, while preserving the geometry of their ambient space. Existing discrete methods are not scalable as they assume access to the complete set of…

Machine Learning · Statistics 2026-03-10 Eduardo Fernandes Montesuma , Yassir Bendou , Mike Gartrell

We study a new variant of consensus problems, termed `local average consensus', in networks of agents. We consider the task of using sensor networks to perform distributed measurement of a parameter which has both spatial (in this paper 1D)…

Systems and Control · Computer Science 2013-09-02 Kai Cai , Brian D. O. Anderson , Changbin Yu , Guoqiang Mao

Given a pre-trained classifier and multiple human experts, we investigate the task of online classification where model predictions are provided for free but querying humans incurs a cost. In this practical but under-explored setting,…

Machine Learning · Computer Science 2023-12-14 Sam Showalter , Alex Boyd , Padhraic Smyth , Mark Steyvers

We consider distributed state estimation in a wireless sensor network without a fusion center. Each sensor performs a global estimation task---based on the past and current measurements of all sensors---using only local processing and local…

Applications · Statistics 2015-05-30 Ondrej Hlinka , Ondrej Sluciak , Franz Hlawatsch , Petar M. Djuric , Markus Rupp

In this work we consider regularized Wasserstein barycenters (average in Wasserstein distance) in Fourier basis. We prove that random Fourier parameters of the barycenter converge to some Gaussian random vector by distribution. The…

Statistics Theory · Mathematics 2021-09-21 Nazar Buzun

We study in this paper a variant of Wasserstein barycenter problem, which we refer to as tree-Wasserstein barycenter, by leveraging a specific class of ground metrics, namely tree metrics, for Wasserstein distance. Drawing on the tree…

Machine Learning · Statistics 2020-02-28 Tam Le , Viet Huynh , Nhat Ho , Dinh Phung , Makoto Yamada