English
Related papers

Related papers: Personalized and Resilient Distributed Learning Th…

200 papers

Decentralized learning with private data is a central problem in machine learning. We propose a novel distillation-based decentralized learning technique that allows multiple agents with private non-iid data to learn from each other,…

Machine Learning · Computer Science 2022-11-30 Andrey Zhmoginov , Mark Sandler , Nolan Miller , Gus Kristiansen , Max Vladymyrov

Distributed control increases system scalability, flexibility, and redundancy. Foundational to such decentralisation is consensus formation, by which decision-making and coordination are achieved. However, decentralised multi-agent systems…

Multiagent Systems · Computer Science 2024-03-11 Agathe Bouis , Christopher Lowe , Ruaridh A. Clark , Malcolm Macdonald

Social power quantifies the ability of individuals to influence others and plays a central role in social influence networks. Yet, computing social power typically requires global knowledge and significant computational or storage…

Systems and Control · Electrical Eng. & Systems 2026-04-07 Ye Tian , Angela Fontan , Yu Kawano , Wei Zhang , Kenji Kashima , Karl H. Johansson

In this paper, we consider learning dictionary models over a network of agents, where each agent is only in charge of a portion of the dictionary elements. This formulation is relevant in Big Data scenarios where large dictionary models may…

Machine Learning · Computer Science 2015-06-18 Jianshu Chen , Zaid J. Towfic , Ali H. Sayed

We address the problem of learning to assign prediction tasks to one agent from a set of available human or AI agents. In particular, we focus on the sequential learning of agent expertise and assignment policies where each agent is…

Human-Computer Interaction · Computer Science 2026-05-28 Shang Wu , Saatvik Kher , Padhraic Smyth

Estimating statistical models within sensor networks requires distributed algorithms, in which both data and computation are distributed across the nodes of the network. We propose a general approach for distributed learning based on…

Machine Learning · Computer Science 2012-07-03 Qiang Liu , Alexander Ihler

This paper focuses on describing the impact of policy actions on individuals' opinions in the presence of social and external influences toward proposing preliminary nudging strategies to achieve a cost-effectiveness trade-off. To this end,…

Systems and Control · Electrical Eng. & Systems 2025-02-04 Valentina Breschi , Chiara Ravazzi , Paolo Frasca , Fabrizio Dabbene , Mara Tanelli

This paper considers a time-varying optimization problem associated with a network of systems, with each of the systems shared by (and affecting) a number of individuals. The objective is to minimize cost functions associated with the…

Optimization and Control · Mathematics 2022-03-15 Ana M. Ospina , Andrea Simonetto , Emiliano Dall'Anese

Motivated by the well established idea that collective wisdom is greater than that of an individual, we propose a novel learning dynamics as a sort of companion to the Abelson model of opinion dynamics. Agents are assumed to make…

Systems and Control · Electrical Eng. & Systems 2025-09-16 Luka Baković , Giacomo Como , Fabio Fagnani , Anton Proskurnikov , Emma Tegling

Enhancing resilience in multi-agent systems in the face of selfish agents is an important problem that requires further characterisation. This work develops a truthful mechanism that avoids self-interested and strategic agents maliciously…

Systems and Control · Electrical Eng. & Systems 2025-07-29 Tianyi Zhong , David Angeli

Most work on supervised learning research has focused on marginal predictions. In decision problems, joint predictive distributions are essential for good performance. Previous work has developed methods for assessing low-order predictive…

Machine Learning · Statistics 2022-03-01 Ian Osband , Zheng Wen , Seyed Mohammad Asghari , Vikranth Dwaracherla , Xiuyuan Lu , Benjamin Van Roy

This article introduces a generalized framework for Decentralized Learning formulated as a Multi-Objective Optimization problem, in which both distributed agents and a central coordinator contribute independent, potentially conflicting…

Optimization and Control · Mathematics 2025-07-21 Roberto Morales , Umberto Biccari

Online learning with streaming data in a distributed and collaborative manner can be useful in a wide range of applications. This topic has been receiving considerable attention in recent years with emphasis on both single-task and…

Multiagent Systems · Computer Science 2017-04-26 Jie Chen , Cédric Richard , Ali H. Sayed

We formulate computation offloading as a decentralized decision-making problem with autonomous agents. We design an interaction mechanism that incentivizes agents to align private and system goals by balancing between competition and…

Multiagent Systems · Computer Science 2022-06-22 Jing Tan , Ramin Khalili , Holger Karl , Artur Hecker

Modeling agent behavior is central to understanding the emergence of complex phenomena in multiagent systems. Prior work in agent modeling has largely been task-specific and driven by hand-engineering domain-specific prior knowledge. We…

Multiagent Systems · Computer Science 2018-08-02 Aditya Grover , Maruan Al-Shedivat , Jayesh K. Gupta , Yura Burda , Harrison Edwards

We study the difficulties in learning that arise from robust and differentially private optimization. We first study convergence of gradient descent based adversarial training with differential privacy, taking a simple binary classification…

Machine Learning · Computer Science 2022-01-10 Jamie Hayes , Borja Balle , M. Pawan Kumar

The rise of connected personal devices together with privacy concerns call for machine learning algorithms capable of leveraging the data of a large number of agents to learn personalized models under strong privacy requirements. In this…

Machine Learning · Computer Science 2018-02-20 Aurélien Bellet , Rachid Guerraoui , Mahsa Taziki , Marc Tommasi

Adaptive networks are well-suited to perform decentralized information processing and optimization tasks and to model various types of self-organized and complex behavior encountered in nature. Adaptive networks consist of a collection of…

Multiagent Systems · Computer Science 2013-05-07 Ali H. Sayed

Federated learning enables machine learning models to learn from private decentralized data without compromising privacy. The standard formulation of federated learning produces one shared model for all clients. Statistical heterogeneity…

Machine Learning · Computer Science 2020-03-20 Viraj Kulkarni , Milind Kulkarni , Aniruddha Pant

Online learning has become increasingly popular on handling massive data. The sequential nature of online learning, however, requires a centralized learner to store data and update parameters. In this paper, we consider online learning with…

Machine Learning · Computer Science 2011-02-07 Feng Yan , Shreyas Sundaram , S. V. N. Vishwanathan , Yuan Qi