English
Related papers

Related papers: Decentralized diffusion-based learning under non-p…

200 papers

This paper addresses a kernel-based learning problem for a network of agents locally observing a latent multidimensional, nonlinear phenomenon in a noisy environment. We propose a learning algorithm that requires only mild a priori…

Multiagent Systems · Computer Science 2024-04-16 Krzysztof Kowalczyk , Paweł Wachel , Cristian R. Rojas

The problem of distributed or decentralized detection and estimation in applications such as wireless sensor networks has often been considered in the framework of parametric models, in which strong assumptions are made about a statistical…

Information Theory · Computer Science 2015-06-25 Joel B. Predd , Sanjeev R. Kulkarni , H. Vincent Poor

Decentralized learning strategies allow a collection of agents to learn efficiently from local data sets without the need for central aggregation or orchestration. Current decentralized learning paradigms typically rely on an averaging…

Machine Learning · Computer Science 2025-01-24 Muyun Li , Aaron Fainman , Stefan Vlaski

Diffusion learning is a framework that endows edge devices with advanced intelligence. By processing and analyzing data locally and allowing each agent to communicate with its immediate neighbors, diffusion effectively protects the privacy…

Machine Learning · Computer Science 2025-05-19 Elsa Rizk , Kun Yuan , Ali H. Sayed

This article proposes an active learning method for high dimensional data, based on intrinsic data geometries learned through diffusion processes on graphs. Diffusion distances are used to parametrize low-dimensional structures on the…

Machine Learning · Computer Science 2019-05-31 Mauro Maggioni , James M. Murphy

We consider the problem of distributed dictionary learning, where a set of nodes is required to collectively learn a common dictionary from noisy measurements. This approach may be useful in several contexts including sensor networks.…

Machine Learning · Statistics 2013-04-15 Pierre Chainais , Cédric Richard

We propose an efficient protocol for decentralized training of deep neural networks from distributed data sources. The proposed protocol allows to handle different phases of model training equally well and to quickly adapt to concept…

Machine Learning · Computer Science 2018-11-14 Michael Kamp , Linara Adilova , Joachim Sicking , Fabian Hüger , Peter Schlicht , Tim Wirtz , Stefan Wrobel

We consider nonparametric sequential hypothesis testing problem when the distribution under the null hypothesis is fully known but the alternate hypothesis corresponds to some other unknown distribution with some loose constraints. We…

Information Theory · Computer Science 2013-11-15 Shouvik Ganguly , K Sahasranand , Vinod Sharma

Diffusion models recently proved to be remarkable priors for Bayesian inverse problems. However, training these models typically requires access to large amounts of clean data, which could prove difficult in some settings. In this work, we…

Machine Learning · Computer Science 2025-11-04 François Rozet , Gérôme Andry , François Lanusse , Gilles Louppe

We study a distributed node-specific parameter estimation problem where each node in a wireless sensor network is interested in the simultaneous estimation of different vectors of parameters that can be of local interest, of common interest…

Systems and Control · Computer Science 2015-10-06 Jorge Plata-Chaves , Mohamad Hasan Bahari , Marc Moonen , Alexander Bertrand

A multitude of imaging and vision tasks have seen recently a major transformation by deep learning methods and in particular by the application of convolutional neural networks. These methods achieve impressive results, even for…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Simon Arridge , Andreas Hauptmann

Nonlocal neural networks have been proposed and shown to be effective in several computer vision tasks, where the nonlocal operations can directly capture long-range dependencies in the feature space. In this paper, we study the nature of…

Machine Learning · Computer Science 2019-01-28 Yunzhe Tao , Qi Sun , Qiang Du , Wei Liu

Observations collected by agents in a network may be unreliable due to observation noise or interference. This paper proposes a distributed algorithm that allows each node to improve the reliability of its own observation by relying solely…

Machine Learning · Computer Science 2022-03-21 Roula Nassif , Virginia Bordignon , Stefan Vlaski , Ali H. Sayed

In this work, we propose a distributed adaptive observer for a class of nonlinear networked systems inspired by biophysical neural network models. Neural systems learn by adjusting intrinsic and synaptic weights in a distributed fashion,…

Systems and Control · Electrical Eng. & Systems 2022-09-22 Thiago B. Burghi , Timothy O'Leary , Rodolphe Sepulchre

This chapter deals with decentralized learning algorithms for in-network processing of graph-valued data. A generic learning problem is formulated and recast into a separable form, which is iteratively minimized using the…

Optimization and Control · Mathematics 2015-04-01 Georgios B. Giannakis , Qing Ling , Gonzalo Mateos , Ioannis D. Schizas , Hao Zhu

We tackle the non-convex problem of learning a personalized deep learning model in a decentralized setting. More specifically, we study decentralized federated learning, a peer-to-peer setting where data is distributed among many clients…

Machine Learning · Computer Science 2021-07-21 Noa Onoszko , Gustav Karlsson , Olof Mogren , Edvin Listo Zec

Diffusion, a fundamental internal mechanism emerging in many physical processes, describes the interaction among different objects. In many learning tasks with limited training samples, the diffusion connects the labeled and unlabeled data…

Machine Learning · Computer Science 2023-05-02 Tangjun Wang , Zehao Dou , Chenglong Bao , Zuoqiang Shi

We consider the problem of distributed learning, where a network of agents collectively aim to agree on a hypothesis that best explains a set of distributed observations of conditionally independent random processes. We propose a…

Optimization and Control · Mathematics 2017-04-12 Angelia Nedić , Alex Olshevsky , César A. Uribe

A common challenge in the natural sciences is to disentangle distinct, unknown sources from observations. Examples of this source separation task include deblending galaxies in a crowded field, distinguishing the activity of individual…

Machine Learning · Computer Science 2025-10-08 Sebastian Wagner-Carena , Aizhan Akhmetzhanova , Sydney Erickson

Distributed learning is the problem of inferring a function in the case where training data is distributed among multiple geographically separated sources. Particularly, the focus is on designing learning strategies with low computational…

Machine Learning · Statistics 2016-07-22 Simone Scardapane
‹ Prev 1 2 3 10 Next ›