English
Related papers

Related papers: Dif-MAML: Decentralized Multi-Agent Meta-Learning

200 papers

Data-Free Meta-Learning (DFML) aims to derive knowledge from a collection of pre-trained models without accessing their original data, enabling the rapid adaptation to new unseen tasks. Current methods often overlook the heterogeneity among…

Machine Learning · Computer Science 2024-12-10 Yongxian Wei , Zixuan Hu , Li Shen , Zhenyi Wang , Yu Li , Chun Yuan , Dacheng Tao

Continual learning aims to provide intelligent agents capable of learning multiple tasks sequentially with neural networks. One of its main challenging, catastrophic forgetting, is caused by the neural networks non-optimal ability to learn…

Machine Learning · Computer Science 2021-01-29 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Nowadays, data-driven, machine and deep learning approaches have provided unprecedented performance in various complex tasks, including image classification and object detection, and in a variety of application areas, like autonomous…

Machine Learning · Computer Science 2022-03-24 Evangelos Georgatos , Christos Mavrokefalidis , Kostas Berberidis

The emerging machine learning paradigm of decentralized federated learning (DFL) has the promise of greatly boosting the deployment of artificial intelligence (AI) by directly learning across distributed agents without centralized…

Machine Learning · Computer Science 2024-08-12 Yudi Huang , Tingyang Sun , Ting He

Decentralized learning strategies allow a collection of agents to learn efficiently from local data sets without the need for central aggregation or orchestration. Current decentralized learning paradigms typically rely on an averaging…

Machine Learning · Computer Science 2025-01-24 Muyun Li , Aaron Fainman , Stefan Vlaski

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are distributed (unevenly) over an extremely large number of \nodes, but the goal remains to…

Machine Learning · Computer Science 2015-11-12 Jakub Konečný , Brendan McMahan , Daniel Ramage

This work studies multi-agent sharing optimization problems with the objective function being the sum of smooth local functions plus a convex (possibly non-smooth) function coupling all agents. This scenario arises in many machine learning…

Optimization and Control · Mathematics 2020-06-17 Sulaiman A. Alghunaim , Ming Yan , Ali H. Sayed

Multiagent reinforcement learning algorithms have not been widely adopted in large scale environments with many agents as they often scale poorly with the number of agents. Using mean field theory to aggregate agents has been proposed as a…

Multiagent Systems · Computer Science 2022-04-14 Sriram Ganapathi Subramanian , Matthew E. Taylor , Mark Crowley , Pascal Poupart

The deployment of large-scale models, such as large language models (LLMs) and sophisticated image generation systems, incurs substantial costs due to their computational demands. To mitigate these costs and address challenges related to…

Machine Learning · Computer Science 2024-10-30 Yuzhe Yang , Yipeng Du , Ahmad Farhan , Claudio Angione , Yue Zhao , Harry Yang , Fielding Johnston , James Buban , Patrick Colangelo

The mean-field framework has been used to find approximate solutions to problems involving very large populations of symmetric, anonymous agents, which may be intractable by other methods. The cooperative mean-field control (MFC) problem…

Multiagent Systems · Computer Science 2025-12-23 Patrick Benjamin , Alessandro Abate

Diffusion learning is a framework that endows edge devices with advanced intelligence. By processing and analyzing data locally and allowing each agent to communicate with its immediate neighbors, diffusion effectively protects the privacy…

Machine Learning · Computer Science 2025-05-19 Elsa Rizk , Kun Yuan , Ali H. Sayed

We consider the fully decentralized machine learning scenario where many users with personal datasets collaborate to learn models through local peer-to-peer exchanges, without a central coordinator. We propose to train personalized models…

Machine Learning · Computer Science 2024-12-20 Valentina Zantedeschi , Aurélien Bellet , Marc Tommasi

Much work has been dedicated to the exploration of Multi-Agent Reinforcement Learning (MARL) paradigms implementing a centralized learning with decentralized execution (CLDE) approach to achieve human-like collaboration in cooperative…

Multiagent Systems · Computer Science 2023-07-26 Piyush K. Sharma , Rolando Fernandez , Erin Zaroukian , Michael Dorothy , Anjon Basak , Derrik E. Asher

Despite the increasing interest in multi-agent reinforcement learning (MARL) in multiple communities, understanding its theoretical foundation has long been recognized as a challenging problem. In this work, we address this problem by…

Machine Learning · Computer Science 2020-12-15 Kaiqing Zhang , Zhuoran Yang , Han Liu , Tong Zhang , Tamer Başar

In meta-learning and its downstream tasks, many methods rely on implicit adaptation to task variations, where multiple factors are mixed together in a single entangled representation. This makes it difficult to interpret which factors drive…

Robotics · Computer Science 2025-09-03 Seonsoo Kim , Jun-Gill Kang , Taehong Kim , Seongil Hong

Meta-learning involves multiple learners, each dedicated to specific tasks, collaborating in a data-constrained setting. In current meta-learning methods, task learners locally learn models from sensitive data, termed support sets. These…

Machine Learning · Computer Science 2024-06-05 Mina Rafiei , Mohammadmahdi Maheri , Hamid R. Rabiee

Federated learning enables many applications benefiting distributed and private datasets of a large number of potential data-holding clients. However, different clients usually have their own particular objectives in terms of the tasks to…

Machine Learning · Computer Science 2022-07-19 Cihat Keçeci , Mohammad Shaqfeh , Hayat Mbayed , Erchin Serpedin

Collaborations among multiple organizations, such as financial institutions, medical centers, and retail markets in decentralized settings are crucial to providing improved service and performance. However, the underlying organizations may…

Machine Learning · Computer Science 2022-10-12 Enmao Diao , Jie Ding , Vahid Tarokh

Modern deep learning techniques have illustrated their excellent capabilities in many areas, but relies on large training data. Optimization-based meta-learning train a model on a variety tasks, such that it can solve new learning tasks…

Machine Learning · Computer Science 2023-02-23 Penghao Jiang , Ke Xin , Zifeng Wang , Chunxi Li

This paper introduces a decentralized multi-agent reinforcement learning framework enabling structurally heterogeneous teams of agents to jointly discover and acquire randomly located targets in environments characterized by partial…

Robotics · Computer Science 2026-01-14 Gabriele Calzolari , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos