English
Related papers

Related papers: Flag Aggregator: Scalable Distributed Training und…

200 papers

Distributed learning paradigms, such as federated and decentralized learning, allow for the coordination of models across a collection of agents, and without the need to exchange raw data. Instead, agents compute model updates locally based…

Machine Learning · Computer Science 2022-04-04 Stefan Vlaski , Christian Schroth , Michael Muma , Abdelhak M. Zoubir

While being an effective framework of learning a shared model across multiple edge devices, federated learning (FL) is generally vulnerable to Byzantine attacks from adversarial edge devices. While existing works on FL mitigate such…

Machine Learning · Computer Science 2022-11-01 Youngjoon Lee , Sangwoo Park , Joonhyuk Kang

State-of-the-art machine learning models are routinely trained on large-scale distributed clusters. Crucially, such systems can be compromised when some of the computing devices exhibit abnormal (Byzantine) behavior and return arbitrary…

Machine Learning · Computer Science 2022-01-25 Konstantinos Konstantinidis , Aditya Ramamoorthy

Given sufficient data from multiple edge devices, federated learning (FL) enables training a shared model without transmitting private data to the central server. However, FL is generally vulnerable to Byzantine attacks from compromised…

Machine Learning · Computer Science 2025-09-18 Youngjoon Lee , Jinu Gong , Joonhyuk Kang

Pervasive computing promotes the installation of connected devices in our living spaces in order to provide services. Two major developments have gained significant momentum recently: an advanced use of edge resources and the integration of…

Machine Learning · Computer Science 2021-10-22 Sannara Ek , François Portet , Philippe Lalanda , German Vega

Federated learning (FL) has become one of the key methods for privacy-preserving collaborative learning, as it enables the transfer of models without requiring local data exchange. Within the FL framework, an aggregation algorithm is…

Machine Learning · Computer Science 2024-11-13 Haizhou Zhang , Xianjia Yu , Tomi Westerlund

This paper delves into the investigation of a distributed aggregative optimization problem within a network. In this scenario, each agent possesses its own local cost function, which relies not only on the local state variable but also on…

Optimization and Control · Mathematics 2025-04-01 Jiaxu Liu , Song Chen , Shengze Cai , Chao Xu , Jian Chu

Federated Learning (FL) enables multiple distributed clients (e.g., mobile devices) to collaboratively train a centralized model while keeping the training data locally on the client. Compared to traditional centralized machine learning, FL…

Machine Learning · Computer Science 2021-09-29 Zhuohang Li , Luyang Liu , Jiaxin Zhang , Jian Liu

The rapid increase in connected devices has signifi- cantly intensified the computational and communication demands on modern telecommunication networks. To address these chal- lenges, integrating advanced Machine Learning (ML) techniques…

Networking and Internet Architecture · Computer Science 2025-11-05 Mengyao Li , Noah Ploch , Sebastian Troia , Carlo Spatocco , Wolfgang Kellerer , Guido Maier

Machine Learning (ML) solutions are nowadays distributed, according to the so-called server/worker architecture. One server holds the model parameters while several workers train the model. Clearly, such architecture is prone to various…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-03 El-Mahdi El-Mhamdi , Rachid Guerraoui , Arsany Guirguis , Lê Nguyên Hoang , Sébastien Rouault

Federated Learning (FL) enables collaborative model training across multiple clients without sharing private data. We consider FL scenarios wherein FL clients are subject to adversarial (Byzantine) attacks, while the FL server is trusted…

Machine Learning · Computer Science 2026-04-30 Emmanouil Kritharakis , Dusan Jakovetic , Antonios Makris , Konstantinos Tserpes

Federated learning (FL) allows multiple clients to collaboratively train a global machine learning model through a server, without exchanging their private training data. However, the decentralized aspect of FL makes it susceptible to…

Cryptography and Security · Computer Science 2025-01-30 Minghong Fang , Seyedsina Nabavirazavi , Zhuqing Liu , Wei Sun , Sundararaja Sitharama Iyengar , Haibo Yang

Federated Learning (FL) enables decentralized model training without sharing raw data. However, it remains vulnerable to Byzantine attacks, which can compromise the aggregation of locally updated parameters at the central server.…

Machine Learning · Computer Science 2025-09-30 Shiyuan Zuo , Rongfei Fan , Cheng Zhan , Jie Xu , Puning Zhao , Han Hu

Distributed optimization with open collaboration is a popular field since it provides an opportunity for small groups/companies/universities, and individuals to jointly solve huge-scale problems. However, standard optimization algorithms…

Optimization and Control · Mathematics 2023-03-09 Nikita Fedin , Eduard Gorbunov

Federated learning has attracted increasing attention at recent large-scale optimization and machine learning research and applications, but is also vulnerable to Byzantine clients that can send any erroneous signals. Robust aggregators are…

Machine Learning · Computer Science 2025-10-07 Ziyi Chen , Su Zhang , Heng Huang

Distributed machine learning has recently become a critical paradigm for training large models on vast datasets. We examine the stochastic optimization problem for deep learning within synchronous parallel computing environments under…

Machine Learning · Computer Science 2024-11-07 Yoni Choukroun , Shlomi Azoulay , Pavel Kisilev

This paper considers the problem of Byzantine fault tolerance in distributed linear regression in a multi-agent system. However, the proposed algorithms are given for a more general class of distributed optimization problems, of which…

Machine Learning · Computer Science 2019-04-05 Nirupam Gupta , Nitin H. Vaidya

Federated Learning (FL) enables heterogeneous clients to collaboratively train a shared model without centralizing their raw data, offering an inherent level of privacy. However, gradients and model updates can still leak sensitive…

Machine Learning · Computer Science 2026-04-07 Rustem Islamov , Grigory Malinovsky , Alexander Gaponov , Aurelien Lucchi , Peter Richtárik , Eduard Gorbunov

In Federated Learning (FL), the distributed nature and heterogeneity of client data present both opportunities and challenges. While collaboration among clients can significantly enhance the learning process, not all collaborations are…

Machine Learning · Computer Science 2024-07-18 Nazarii Tupitsa , Samuel Horváth , Martin Takáč , Eduard Gorbunov

In this paper, we investigate the problem of distributed learning (DL) in the presence of Byzantine attacks. For this problem, various robust bounded aggregation (RBA) rules have been proposed at the central server to mitigate the impact of…

Machine Learning · Computer Science 2026-03-18 Chengxi Li , Ming Xiao , Mikael Skoglund