English
Related papers

Related papers: Exact and Approximate Heterogeneous Bayesian Decen…

200 papers

There has recently been considerable interest in addressing the problem of unifying distributed statistical analyses into a single coherent inference. This problem naturally arises in a number of situations, including in big-data settings,…

Methodology · Statistics 2021-02-04 Hongsheng Dai , Murray Pollock , Gareth Roberts

This paper presents an approximate method for performing Bayesian inference in models with conditional independence over a decentralized network of learning agents. The method first employs variational inference on each individual learning…

Machine Learning · Computer Science 2014-06-13 Trevor Campbell , Jonathan P. How

This work examines the problem of using finite Gaussian mixtures (GM) probability density functions in recursive Bayesian peer-to-peer decentralized data fusion (DDF). It is shown that algorithms for both exact and approximate GM DDF lead…

Signal Processing · Electrical Eng. & Systems 2019-07-10 Nisar R. Ahmed

We address the goal of conducting inference about a smooth finite-dimensional parameter by utilizing individual-level data from various independent sources. Recent advancements have led to the development of a comprehensive theory capable…

Statistics Theory · Mathematics 2025-11-19 Ellen Graham , Marco Carone , Andrea Rotnitzky

In this paper, we deal with distributed estimation problems in diffusion networks with heterogeneous nodes, i.e., nodes that either implement different adaptive rules or differ in some other aspect such as the filter structure or length, or…

Systems and Control · Computer Science 2017-09-05 Jesus Fernandez-Bes , Jerónimo Arenas-García , Magno T. M. Silva , Luis A. Azpicueta-Ruiz

We present a practical asynchronous data fusion model for networked agents to perform distributed Bayesian learning without sharing raw data. Our algorithm uses a gossip-based approach where pairs of randomly selected agents employ…

Machine Learning · Computer Science 2022-11-17 Kinjal Bhar , He Bai , Jemin George , Carl Busart

The emergence of the Internet-of-Things and cyber-physical systems necessitates the coordination of access to limited communication resources in an autonomous and distributed fashion. Herein, the optimal design of a wireless sensing system…

Systems and Control · Electrical Eng. & Systems 2020-05-26 Xu Zhang , Marcos M. Vasconcelos , Wei Cui , Urbashi Mitra

We introduce a distributed, cooperative framework and method for Bayesian estimation and control in decentralized agent networks. Our framework combines joint estimation of time-varying global and local states with information-seeking…

Systems and Control · Computer Science 2015-09-24 Florian Meyer , Henk Wymeersch , Markus Fröhle , Franz Hlawatsch

The integration of data and knowledge from several sources is known as data fusion. When data is only available in a distributed fashion or when different sensors are used to infer a quantity of interest, data fusion becomes essential. In…

Machine Learning · Computer Science 2023-12-11 Peng Wu , Tales Imbiriba , Victor Elvira , Pau Closas

In systems biology, it is becoming increasingly common to measure biochemical entities at different levels of the same biological system. Hence, data fusion problems are abundant in the life sciences. With the availability of a multitude of…

This paper considers a distributed adaptive optimization problem, where all agents only have access to their local cost functions with a common unknown parameter, whereas they mean to collaboratively estimate the true parameter and find the…

Optimization and Control · Mathematics 2025-09-03 Yaqun Yang , Jinlong Lei , Guanghui Wen , Yiguang Hong

Distributed learning techniques such as federated learning have enabled multiple workers to train machine learning models together to reduce the overall training time. However, current distributed training algorithms (centralized or…

Machine Learning · Computer Science 2020-02-25 Zhenheng Tang , Shaohuai Shi , Xiaowen Chu

Computational modelling of diffusion in heterogeneous media is prohibitively expensive for problems with fine-scale heterogeneities. A common strategy for resolving this issue is to decompose the domain into a number of non-overlapping…

Computational Physics · Physics 2021-08-26 Nathan G. March , Elliot J. Carr , Ian W. Turner

There is significant interest in learning and optimizing a complex system composed of multiple sub-components, where these components may be agents or autonomous sensors. Among the rich literature on this topic, agent-based and…

Machine Learning · Computer Science 2021-07-08 Kai Wang , Bryan Wilder , Sze-chuan Suen , Bistra Dilkina , Milind Tambe

Although federated learning has achieved many breakthroughs recently, the heterogeneous nature of the learning environment greatly limits its performance and hinders its real-world applications. The heterogeneous data, time-varying wireless…

Machine Learning · Computer Science 2023-02-22 Jingxin Li , Toktam Mahmoodi , Hak-Keung Lam

Across science and engineering, mean-field methods have been a powerful and versatile approach for the analysis of systems of many interacting elements. However, common arguments used to characterize an infinite population limit can be…

Optimization and Control · Mathematics 2026-05-01 Connor S. Braun , Sina Sanjari , Naci Saldi , Gunnar Blohm , Serdar Yüksel

We present a Bayesian data fusion method to approximate a posterior distribution from an ensemble of particle estimates that only have access to subsets of the data. Our approach relies on approximate probabilistic inference of model…

Computation · Statistics 2020-10-28 Caleb Miller , Michael D. Schneider , Jem N. Corcoran , Jason Bernstein

Originated from distributed learning, federated learning enables privacy-preserved collaboration on a new abstracted level by sharing the model parameters only. While the current research mainly focuses on optimizing learning algorithms and…

Machine Learning · Computer Science 2020-09-17 Cong Wang , Yuanyuan Yang , Pengzhan Zhou

We consider the fully decentralized machine learning scenario where many users with personal datasets collaborate to learn models through local peer-to-peer exchanges, without a central coordinator. We propose to train personalized models…

Machine Learning · Computer Science 2024-12-20 Valentina Zantedeschi , Aurélien Bellet , Marc Tommasi

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez