English
Related papers

Related papers: Combating Exacerbated Heterogeneity for Robust Mod…

200 papers

Adversarial training has proven to be a highly effective method for improving the robustness of deep neural networks against adversarial attacks. Nonetheless, it has been observed to exhibit a limitation in terms of robust fairness,…

Machine Learning · Computer Science 2025-01-09 Hongxin Zhi , Hongtao Yu , Shaome Li , Xiuming Zhao , Yiteng Wu

Traditional Federated Learning (FL) faces significant challenges in terms of efficiency and accuracy, particularly in heterogeneous environments where clients employ diverse model architectures and have varying computational resources. Such…

Machine Learning · Computer Science 2025-05-13 Jiacheng Wang , Hongtao Lv , Lei Liu

Federated Learning (FL) emerged as a learning method to enable the server to train models over data distributed among various clients. These clients are protective about their data being leaked to the server, any other client, or an…

Machine Learning · Computer Science 2025-01-27 Uday Bhaskar , Varul Srivastava , Avyukta Manjunatha Vummintala , Naresh Manwani , Sujit Gujar

Federated learning (FL) is a paradigm where many clients collaboratively train a model under the coordination of a central server, while keeping the training data locally stored. However, heterogeneous data distributions over different…

Machine Learning · Computer Science 2022-05-27 Yaqi Sun , Shijing Si , Jianzong Wang , Yuhan Dong , Zhitao Zhu , Jing Xiao

Despite their performance, Artificial Neural Networks are not reliable enough for most of industrial applications. They are sensitive to noises, rotations, blurs and adversarial examples. There is a need to build defenses that protect…

Machine Learning · Computer Science 2020-08-20 Alfred Laugros , Alice Caplier , Matthieu Ospici

Deep Neural Networks are vulnerable to adversarial attacks. Among many defense strategies, adversarial training with untargeted attacks is one of the most effective methods. Theoretically, adversarial perturbation in untargeted attacks can…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Pengyue Hou , Jie Han , Xingyu Li

Federated Learning offers a solution for decentralised model training, addressing the difficulties associated with distributed data and privacy in machine learning. However, the fact of data heterogeneity in federated learning frequently…

Machine Learning · Computer Science 2025-09-10 Ozgu Goksu , Nicolas Pugeault

Deep learning models continue to advance in accuracy, yet they remain vulnerable to adversarial attacks, which often lead to the misclassification of adversarial examples. Adversarial training is used to mitigate this problem by increasing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Leo Hyun Park , Jaeuk Kim , Myung Gyo Oh , Jaewoo Park , Taekyoung Kwon

As data are increasingly being stored in different silos and societies becoming more aware of data privacy issues, the traditional centralized training of artificial intelligence (AI) models is facing efficiency and privacy challenges.…

Cryptography and Security · Computer Science 2022-01-20 Lingjuan Lyu , Han Yu , Xingjun Ma , Chen Chen , Lichao Sun , Jun Zhao , Qiang Yang , Philip S. Yu

Robust overfitting widely exists in adversarial training of deep networks. The exact underlying reasons for this are still not completely understood. Here, we explore the causes of robust overfitting by comparing the data distribution of…

Machine Learning · Computer Science 2022-06-23 Chaojian Yu , Bo Han , Li Shen , Jun Yu , Chen Gong , Mingming Gong , Tongliang Liu

Federated Learning (FL) trains deep models across edge devices without centralizing raw data, preserving user privacy. However, client heterogeneity slows down convergence and limits global model accuracy. Clustered FL (CFL) mitigates this…

Machine Learning · Computer Science 2026-02-10 Minghao Li , Dmitrii Avdiukhin , Rana Shahout , Nikita Ivkin , Vladimir Braverman , Minlan Yu

In practical federated learning (FL), the large communication overhead between clients and the server is often a significant bottleneck. Gradient compression methods can effectively reduce this overhead, while error feedback (EF) restores…

Machine Learning · Computer Science 2026-02-13 Diying Yang , Yingwei Hou , Weigang Wu

Machine learning algorithms with empirical risk minimization are vulnerable under distributional shifts due to the greedy adoption of all the correlations found in training data. There is an emerging literature on tackling this problem by…

Machine Learning · Computer Science 2022-11-22 Jiashuo Liu , Zheyan Shen , Peng Cui , Linjun Zhou , Kun Kuang , Bo Li

Federated learning enables multiple institutions to collaboratively train machine learning models on their local data in a privacy-preserving way. However, its distributed nature often leads to significant heterogeneity in data…

Machine Learning · Computer Science 2021-07-20 Liangqiong Qu , Niranjan Balachandar , Daniel L Rubin

Federated learning (FL) enables distributed training with private client data, but its convergence is hindered by system heterogeneity under realistic communication scenarios. Most FL schemes addressing system heterogeneity utilize global…

Machine Learning · Computer Science 2025-09-19 Keumseo Ryum , Jinu Gong , Joonhyuk Kang

Federated Learning (FL) has emerged as a promising approach to address privacy concerns inherent in Machine Learning (ML) practices. However, conventional FL methods, particularly those following the Centralized FL (CFL) paradigm, utilize a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-12 Chao Feng , Alberto Huertas Celdrán , Jan von der Assen , Enrique Tomás Martínez Beltrán , Gérôme Bovet , Burkhard Stiller

Corruptions due to data perturbations and label noise are prevalent in the datasets from unreliable sources, which poses significant threats to model training. Despite existing efforts in developing robust models, current learning methods…

Machine Learning · Computer Science 2024-05-08 Peng-Fei Zhang , Zi Huang , Xin-Shun Xu , Guangdong Bai

In the field of heterogeneous federated learning (FL), the key challenge is to efficiently and collaboratively train models across multiple clients with different data distributions, model structures, task objectives, computational…

Machine Learning · Computer Science 2025-03-11 Chuan Chen , Tianchi Liao , Xiaojun Deng , Zihou Wu , Sheng Huang , Zibin Zheng

Federated learning enables collaborative model training across distributed clients while preserving data privacy. However, in practical deployments, device heterogeneity, non-independent, and identically distributed (Non-IID) data often…

Artificial Intelligence · Computer Science 2026-02-20 Jin Wang , Hui Ma , Fei Xing , Ming Yan

Motivated by the high resource costs and privacy concerns associated with centralized machine learning, federated learning (FL) has emerged as an efficient alternative that enables clients to collaboratively train a global model while…

Machine Learning · Computer Science 2025-09-10 Yiyue Chen , Usman Akram , Chianing Wang , Haris Vikalo