English
Related papers

Related papers: Distributed Gaussian Learning over Time-varying Di…

200 papers

Signal processing and machine learning algorithms for data supported over graphs, require the knowledge of the graph topology. Unless this information is given by the physics of the problem (e.g., water supply networks, power grids), the…

Signal Processing · Electrical Eng. & Systems 2021-02-11 Alberto Natali , Mario Coutino , Elvin Isufi , Geert Leus

In this paper, the problem of online distributed zeroth-order optimization subject to a set constraint is studied via a multi-agent network, where each agent can communicate with its immediate neighbors via a time-varying directed graph.…

Systems and Control · Electrical Eng. & Systems 2025-11-05 Yanfu Qin , Kaihong Lu

In this paper, the problem of distributed optimization is studied via a network of agents. Each agent only has access to a noisy gradient of its own objective function, and can communicate with its neighbors via a network. To handle this…

Optimization and Control · Mathematics 2025-06-19 Yuchen Yang , Kaihong Lu , Long Wang

We study the Gaussian Process regression model in the context of training data with noise in both input and output. The presence of two sources of noise makes the task of learning accurate predictive models extremely challenging. However,…

Machine Learning · Statistics 2015-07-03 Cuong Tran , Vladimir Pavlovic , Robert Kopp

We analyse the learning performance of Distributed Gradient Descent in the context of multi-agent decentralised non-parametric regression with the square loss function when i.i.d. samples are assigned to agents. We show that if agents hold…

Machine Learning · Statistics 2019-11-14 Dominic Richards , Patrick Rebeschini

We consider the distributed optimization problem where $n$ agents each possessing a local cost function, collaboratively minimize the average of the $n$ cost functions over a connected network. Assuming stochastic gradient information is…

Optimization and Control · Mathematics 2021-05-12 Kun Huang , Shi Pu

This work addresses the problem of graph learning from data following a Gaussian Graphical Model (GGM) with a time-varying mean. Graphical Lasso (GL), the standard method for estimating sparse precision matrices, assumes that the observed…

Machine Learning · Computer Science 2025-03-26 Samuel Rey , Ernesto Curbelo , Luca Martino , Fernando Llorente , Antonio G. Marques

We study the problem of distributed zero-order optimization for a class of strongly convex functions. They are formed by the average of local objectives, associated to different nodes in a prescribed network of connections. We propose a…

Optimization and Control · Mathematics 2021-06-29 Arya Akhavan , Massimiliano Pontil , Alexandre B. Tsybakov

This paper studies the distributed adaptiveestimation problems for stochastic large regression modelswith an infinite number of parameters. By constructing a re-cursive local cost function, we propose a novel distributedrecursive least…

Systems and Control · Electrical Eng. & Systems 2026-04-29 Die Gan , Siyu Xie , Zhixin Liu , Xuebo Zhang

Inspired by recent advances in distributed algorithms for approximating Wasserstein barycenters, we propose a novel distributed algorithm for this problem. The main novelty is that we consider time-varying computational networks, which are…

Optimization and Control · Mathematics 2023-07-26 Olga Yufereva , Michael Persiianov , Pavel Dvurechensky , Alexander Gasnikov , Dmitry Kovalev

Motivated by the needs of resiliency, scalability, and plug-and-play operation, distributed decision-making is becoming increasingly prevalent. The problem of achieving consensus in a multi-agent system is at the core of distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-21 Vivek Khatana , Murti V. Salapaka

This paper studies distributed adaptive estimation over sensor networks with partially unknown source dynamics. We present parallel continuous-time and discrete-time designs in which each node runs a local adaptive observer and exchanges…

Systems and Control · Electrical Eng. & Systems 2026-05-18 Moh Kamalul Wafi , Hamidreza Montazeri Hedesh , Milad Siami

Bayesian optimisation is a popular technique for hyperparameter learning but typically requires initial exploration even in cases where similar prior tasks have been solved. We propose to transfer information across tasks using learnt…

Machine Learning · Statistics 2019-05-28 Ho Chung Leon Law , Peilin Zhao , Lucian Chan , Junzhou Huang , Dino Sejdinovic

This paper re-examines the problem of parameter estimation in Bayesian networks with missing values and hidden variables from the perspective of recent work in on-line learning [Kivinen & Warmuth, 1994]. We provide a unified framework for…

Machine Learning · Computer Science 2013-02-08 Eric Bauer , Daphne Koller , Yoram Singer

The aim of this paper is to propose distributed strategies for adaptive learning of signals defined over graphs. Assuming the graph signal to be bandlimited, the method enables distributed reconstruction, with guaranteed performance in…

Machine Learning · Computer Science 2017-08-02 P. Di Lorenzo , P. Banelli , S. Barbarossa , S. Sardellitti

We propose communication-efficient distributed estimation and inference methods for the transelliptical graphical model, a semiparametric extension of the elliptical distribution in the high dimensional regime. In detail, the proposed…

Machine Learning · Statistics 2016-12-30 Pan Xu , Lu Tian , Quanquan Gu

In this paper, we address the problem of simultaneous classification and estimation of hidden parameters in a sensor network with communications constraints. In particular, we consider a network of noisy sensors which measure a common…

Multiagent Systems · Computer Science 2012-06-19 Fabio Fagnani , Sophie M. Fosson , Chiara Ravazzi

We consider a decentralized stochastic learning problem where data points are distributed among computing nodes communicating over a directed graph. As the model size gets large, decentralized learning faces a major bottleneck that is the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-23 Hossein Taheri , Aryan Mokhtari , Hamed Hassani , Ramtin Pedarsani

We study the so-called distributed two-time-scale gradient method for solving convex optimization problems over a network of agents when the communication bandwidth between the nodes is limited, and so information that is exchanged between…

Systems and Control · Electrical Eng. & Systems 2021-06-01 Marcos M. Vasconcelos , Thinh T. Doan , Urbashi Mitra

Gaussian process (GP) models have received increasing attention in recent years due to their superb prediction accuracy and modeling flexibility. To address the computational burdens of GP models for large-scale datasets, distributed…

Machine Learning · Statistics 2026-02-11 Haoyuan Chen , Rui Tuo