English
Related papers

Related papers: Robust and Efficient Aggregation for Distributed L…

200 papers

This paper deals with distributed policy optimization in reinforcement learning, which involves a central controller and a group of learners. In particular, two typical settings encountered in several applications are considered:…

Machine Learning · Computer Science 2021-04-21 Tianyi Chen , Kaiqing Zhang , Georgios B. Giannakis , Tamer Başar

Distributed machine learning has recently become a critical paradigm for training large models on vast datasets. We examine the stochastic optimization problem for deep learning within synchronous parallel computing environments under…

Machine Learning · Computer Science 2024-11-07 Yoni Choukroun , Shlomi Azoulay , Pavel Kisilev

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

Recently, federated learning has emerged as a promising approach for training a global model using data from multiple organizations without leaking their raw data. Nevertheless, directly applying federated learning to real-world tasks faces…

Machine Learning · Computer Science 2022-04-19 Bingzhe Wu , Zhipeng Liang , Yuxuan Han , Yatao Bian , Peilin Zhao , Junzhou Huang

Decentralized federated learning (DFL) enables devices to collaboratively train models over complex network topologies without relying on a central controller. In this setting, local data remains private, but its quality and quantity can…

Machine Learning · Computer Science 2025-06-05 Samuele Sabella , Chiara Boldrini , Lorenzo Valerio , Andrea Passarella , Marco Conti

Discriminative learning machines often need a large set of labeled samples for training. Active learning (AL) settings assume that the learner has the freedom to ask an oracle to label its desired samples. Traditional AL algorithms…

Machine Learning · Statistics 2018-05-24 Arash Mehrjou , Mehran Khodabandeh , Greg Mori

Federated Learning is a framework that jointly trains a model \textit{with} complete knowledge on a remotely placed centralized server, but \textit{without} the requirement of accessing the data stored in distributed machines. Some work…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-26 Jia Qian , Lars Kai Hansen , Xenofon Fafoutis , Prayag Tiwari , Hari Mohan Pandey

Due to the pervasive diffusion of personal mobile and IoT devices, many ``smart environments'' (e.g., smart cities and smart factories) will be, among others, generators of huge amounts of data. Currently, this is typically achieved through…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-28 Lorenzo Valerio , Andrea Passarella , Marco Conti

Federated learning (FL) enables collaborative model training without direct data sharing, but its performance can degrade significantly in the presence of data distribution perturbations. Distributionally robust optimization (DRO) provides…

Machine Learning · Computer Science 2025-09-30 Zifan Wang , Xinlei Yi , Xenia Konti , Michael M. Zavlanos , Karl H. Johansson

Multi-agent learning has gained increasing attention to tackle distributed machine learning scenarios under constrictions of data exchanging. However, existing multi-agent learning models usually consider data fusion under fixed and…

Machine Learning · Computer Science 2023-06-09 Enpei Zhang , Shuo Tang , Xiaowen Dong , Siheng Chen , Yanfeng Wang

Collaborative learning in peer-to-peer networks offers the benefits of distributed learning while mitigating the risks associated with single points of failure inherent in centralized servers. However, adversarial workers pose potential…

Machine Learning · Computer Science 2025-01-09 Chandreyee Bhowmick , Xenofon Koutsoukos

Federated learning has recently emerged as a paradigm promising the benefits of harnessing rich data from diverse sources to train high quality models, with the salient features that training datasets never leave local devices. Only model…

Cryptography and Security · Computer Science 2022-02-07 Yifeng Zheng , Shangqi Lai , Yi Liu , Xingliang Yuan , Xun Yi , Cong Wang

Pervasive computing promotes the installation of connected devices in our living spaces in order to provide services. Two major developments have gained significant momentum recently: an advanced use of edge resources and the integration of…

Machine Learning · Computer Science 2021-10-22 Sannara Ek , François Portet , Philippe Lalanda , German Vega

Federated Learning enables multiple data centers to train a central model collaboratively without exposing any confidential data. Even though deterministic models are capable of performing high prediction accuracy, their lack of calibration…

Machine Learning · Computer Science 2022-11-24 Atahan Ozer , Kadir Burak Buldu , Abdullah Akgül , Gozde Unal

Data privacy and sharing has always been a critical issue when trying to build complex deep learning-based systems to model data. Facilitation of a decentralized approach that could take benefit from data across multiple nodes while not…

Machine Learning · Computer Science 2020-11-24 Pratik Ratadiya , Khushi Asawa , Omkar Nikhal

Modern mobile devices have access to a wealth of data suitable for learning models, which in turn can greatly improve the user experience on the device. For example, language models can improve speech recognition and text entry, and image…

Machine Learning · Computer Science 2023-01-30 H. Brendan McMahan , Eider Moore , Daniel Ramage , Seth Hampson , Blaise Agüera y Arcas

In many applications, data is collected in batches, some of which are corrupt or even adversarial. Recent work derived optimal robust algorithms for estimating discrete distributions in this setting. We consider a general framework of…

Machine Learning · Statistics 2020-02-26 Ayush Jain , Alon Orlitsky

Federated learning is vulnerable to various attacks, such as model poisoning and backdoor attacks, even if some existing defense strategies are used. To address this challenge, we propose an attack-adaptive aggregation strategy to defend…

Machine Learning · Computer Science 2021-08-09 Ching Pui Wan , Qifeng Chen

Federated learning (FL) is an approach to training machine learning models that takes advantage of multiple distributed datasets while maintaining data privacy and reducing communication costs associated with sharing local datasets.…

Machine Learning · Computer Science 2024-12-06 John Fischer , Marko Orescanin , Justin Loomis , Patrick McClure

Distributed machine learning (ML) is a modern computation paradigm that divides its workload into independent tasks that can be simultaneously achieved by multiple machines (i.e., agents) for better scalability. However, a typical…

Machine Learning · Computer Science 2018-11-14 Trong Nghia Hoang , Quang Minh Hoang , Kian Hsiang Low , Jonathan How