English
Related papers

Related papers: Collective Online Learning of Gaussian Processes i…

200 papers

This work studies the intersection of continual and federated learning, in which independent agents face unique tasks in their environments and incrementally develop and share knowledge. We introduce a mathematical framework capturing the…

Machine Learning · Computer Science 2024-12-24 Long Le , Marcel Hussing , Eric Eaton

In the era of deep learning (DL), convolutional neural networks (CNNs), and large language models (LLMs), machine learning (ML) models are becoming increasingly complex, demanding significant computational resources for both inference and…

Machine Learning · Computer Science 2024-05-27 Madison Threadgill , Andreas Gerstlauer

This paper introduces an innovative approach to enhance distributed cooperative learning using Gaussian process (GP) regression in multi-agent systems (MASs). The key contribution of this work is the development of an elective learning…

Machine Learning · Computer Science 2024-02-06 Zewen Yang , Xiaobing Dai , Akshat Dubey , Sandra Hirche , Georges Hattab

Distributed machine learning (ML) can bring more computational resources to bear than single-machine learning, thus enabling reductions in training time. Distributed learning partitions models and data over many machines, allowing model and…

Machine Learning · Computer Science 2022-04-20 Binhang Yuan , Cameron R. Wolfe , Chen Dun , Yuxin Tang , Anastasios Kyrillidis , Christopher M. Jermaine

Machine learning (ML) is about computational methods that enable machines to learn concepts from experience. In handling a wide variety of experience ranging from data instances, knowledge, constraints, to rewards, adversaries, and lifelong…

Machine Learning · Computer Science 2023-01-11 Zhiting Hu , Eric P. Xing

Machine learning (ML) tasks are becoming ubiquitous in today's network applications. Federated learning has emerged recently as a technique for training ML models at the network edge by leveraging processing capabilities across the nodes…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-26 Seyyedali Hosseinalipour , Christopher G. Brinton , Vaneet Aggarwal , Huaiyu Dai , Mung Chiang

Machine Learning (ML) techniques have begun to dominate data analytics applications and services. Recommendation systems are a key component of online service providers. The financial industry has adopted ML to harness large volumes of data…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-29 Richard Mortier , Hamed Haddadi , Sandra Servia , Liang Wang

This work proposes a decentralized architecture, where individual agents aim at solving a classification problem while observing streaming features of different dimensions and arising from possibly different distributions. In the context of…

Machine Learning · Computer Science 2022-12-27 Virginia Bordignon , Stefan Vlaski , Vincenzo Matta , Ali H. Sayed

It can largely benefit the reinforcement learning (RL) process of each agent if multiple geographically distributed agents perform their separate RL tasks cooperatively. Different from multi-agent reinforcement learning (MARL) where…

Machine Learning · Computer Science 2023-10-03 Kaiyue Wu , Xiao-Jun Zeng

Gaussian Processes (GPs) are a powerful tool for probabilistic modeling, but their performance is often constrained in complex, large-scale real-world domains due to the limited expressivity of classical kernels. Quantum computing offers…

Multiagent Systems · Computer Science 2026-05-13 Meet Gandhi , George P. Kontoudis

Cooperative online scalar field mapping is an important task for multi-robot systems. Gaussian process regression is widely used to construct a map that represents spatial information with confidence intervals. However, it is difficult to…

Robotics · Computer Science 2024-01-24 Tianyi Ding , Ronghao Zheng , Senlin Zhang , Meiqin Liu

We consider the problem of distributedly estimating Gaussian processes in multi-agent frameworks. Each agent collects few measurements and aims to collaboratively reconstruct a common estimate based on all data. Agents are assumed with…

Multiagent Systems · Computer Science 2018-05-11 Gianluigi Pillonetto , Luca Schenato , Damiano Varagnolo

We consider an online estimation problem involving a set of agents. Each agent has access to a (personal) process that generates samples from a real-valued distribution and seeks to estimate its mean. We study the case where some of the…

Machine Learning · Computer Science 2022-12-20 Mahsa Asadi , Aurélien Bellet , Odalric-Ambrym Maillard , Marc Tommasi

Distributed multi-task learning (DMTL) effectively improves model generalization performance through the collaborative training of multiple related models. However, in large-scale learning scenarios, communication bottlenecks severely limit…

Information Theory · Computer Science 2025-07-25 Minquan Cheng , Yongkang Wang , Lingyu Zhang , Youlong Wu

We propose DistGP: a multi-robot learning method for collaborative learning of a global function using only local experience and computation. We utilise a sparse Gaussian process (GP) model with a factorisation that mirrors the multi-robot…

Robotics · Computer Science 2026-03-10 Seth Nabarro , Mark van der Wilk , Andrew J. Davison

Federated learning (FL) is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. One central server is not enough, due to…

Gaussian processes (GPs) stand as crucial tools in machine learning and signal processing, with their effectiveness hinging on kernel design and hyper-parameter optimization. This paper presents a novel GP linear multiple kernel (LMK) and a…

Machine Learning · Computer Science 2025-01-17 Richard Cornelius Suwandi , Zhidi Lin , Feng Yin , Zhiguo Wang , Sergios Theodoridis

Scalable and efficient distributed learning is one of the main driving forces behind the recent rapid advancement of machine learning and artificial intelligence. One prominent feature of this topic is that recent progresses have been made…

Machine Learning · Computer Science 2021-04-13 Ji Liu , Ce Zhang

Various collaborative distributed machine learning (CDML) systems, including federated learning systems and swarm learning systems, with diferent key traits were developed to leverage resources for the development and use of machine…

Multiagent Systems · Computer Science 2024-11-22 David Jin , Niclas Kannengießer , Sascha Rank , Ali Sunyaev

Federated learning (FL) refers to a distributed machine learning framework involving learning from several decentralized edge clients without sharing local dataset. This distributed strategy prevents data leakage and enables on-device…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-28 Taki Hasan Rafi , Faiza Anan Noor , Tahmid Hussain , Dong-Kyu Chae , Zhaohui Yang