English
Related papers

Related papers: Curse or Redemption? How Data Heterogeneity Affect…

200 papers

Federated learning enables thousands of participants to construct a deep learning model without sharing their private training data with each other. For example, multiple smartphones can jointly train a next-word predictor for keyboards…

Cryptography and Security · Computer Science 2019-08-07 Eugene Bagdasaryan , Andreas Veit , Yiqing Hua , Deborah Estrin , Vitaly Shmatikov

This paper focuses on addressing the practical yet challenging problem of model heterogeneity in federated learning, where clients possess models with different network structures. To track this problem, we propose a novel framework called…

Machine Learning · Computer Science 2023-10-30 Jiaqi Wang , Xingyi Yang , Suhan Cui , Liwei Che , Lingjuan Lyu , Dongkuan Xu , Fenglong Ma

Federated Instruction Tuning (FIT) enables collaborative instruction tuning of large language models across multiple organizations (clients) in a cross-silo setting without requiring the sharing of private instructions. Recent findings on…

Cryptography and Security · Computer Science 2026-03-03 Haodong Zhao , Jinming Hu , Zhaomin Wu , Zongru Wu , Wei Du , Junyi Hou , Caibei Zhao , Zhuosheng Zhang , Bingsheng He , Gongshen Liu

Federated learning (FL), an emerging distributed machine learning paradigm, has been applied to various privacy-preserving scenarios. However, due to its distributed nature, FL faces two key issues: the non-independent and identical…

Machine Learning · Computer Science 2024-10-18 Youpeng Li , Xinda Wang , Fuxun Yu , Lichao Sun , Wenbin Zhang , Xuyu Wang

Robustness of machine learning models is critical for security related applications, where real-world adversaries are uniquely focused on evading neural network based detectors. Prior work mainly focus on crafting adversarial examples (AEs)…

Machine Learning · Computer Science 2021-11-01 Ecenaz Erdemir , Jeffrey Bickford , Luca Melis , Sergul Aydore

Optimizing prediction accuracy can come at the expense of fairness. Towards minimizing discrimination against a group, fair machine learning algorithms strive to equalize the behavior of a model across different groups, by imposing a…

Machine Learning · Statistics 2020-06-17 Hongyan Chang , Ta Duy Nguyen , Sasi Kumar Murakonda , Ehsan Kazemi , Reza Shokri

In the context of the growing proliferation of user devices and the concurrent surge in data volumes, the complexities arising from the substantial increase in data have posed formidable challenges to conventional machine learning model…

Machine Learning · Computer Science 2025-11-24 Eyad Gad , Zubair Md Fadlullah , Mostafa M. Fouda

Federated learning has emerged as a promising privacy-preserving solution for machine learning domains that rely on user interactions, particularly recommender systems and online learning to rank. While there has been substantial research…

Cryptography and Security · Computer Science 2025-03-04 Dzung Pham , Shreyas Kulkarni , Amir Houmansadr

We propose a novel contrastive learning framework to effectively address the challenges of data heterogeneity in federated learning. We first analyze the inconsistency of gradient updates across clients during local training and establish…

Machine Learning · Computer Science 2024-06-03 Seonguk Seo , Jinkyu Kim , Geeho Kim , Bohyung Han

With the rapid proliferation of smart mobile devices, federated learning (FL) has been widely considered for application in wireless networks for distributed model training. However, data heterogeneity, e.g., non-independently identically…

Machine Learning · Computer Science 2023-08-08 Xuefeng Han , Jun Li , Wen Chen , Zhen Mei , Kang Wei , Ming Ding , H. Vincent Poor

Federated Learning (FL) allows multiple clients to collaboratively train a Neural Network (NN) model on their private data without revealing the data. Recently, several targeted poisoning attacks against FL have been introduced. These…

Cryptography and Security · Computer Science 2022-01-04 Phillip Rieger , Thien Duc Nguyen , Markus Miettinen , Ahmad-Reza Sadeghi

Federated learning (FL) is a distributed learning process that uses a trusted aggregation server to allow multiple parties (or clients) to collaboratively train a machine learning model without having them share their private data. Recent…

Cryptography and Security · Computer Science 2023-10-04 Jorge Castillo , Phillip Rieger , Hossein Fereidooni , Qian Chen , Ahmad Sadeghi

Federated learning is particularly susceptible to model poisoning and backdoor attacks because individual users have direct control over the training data and model updates. At the same time, the attack power of an individual user is…

Machine Learning · Computer Science 2022-10-18 Yuxin Wen , Jonas Geiping , Liam Fowl , Hossein Souri , Rama Chellappa , Micah Goldblum , Tom Goldstein

The performance of Federated Learning (FL) hinges on the effectiveness of utilizing knowledge from distributed datasets. Traditional FL methods adopt an aggregate-then-adapt framework, where clients update local models based on a global…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yuan Wang , Huazhu Fu , Renuga Kanagavelu , Qingsong Wei , Yong Liu , Rick Siow Mong Goh

Federated learning (FL) is an effective mechanism for data privacy in recommender systems by running machine learning model training on-device. While prior FL optimizations tackled the data and system heterogeneity challenges faced by FL,…

Information Retrieval · Computer Science 2022-06-07 Kiwan Maeng , Haiyu Lu , Luca Melis , John Nguyen , Mike Rabbat , Carole-Jean Wu

Federated Learning (FL) is a promising research paradigm that enables the collaborative training of machine learning models among various parties without the need for sensitive information exchange. Nonetheless, retaining data in individual…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Sara Pieri , Jose Renato Restom , Samuel Horvath , Hisham Cholakkal

In federated learning, communication cost is often a critical bottleneck to scale up distributed optimization algorithms to collaboratively learn a model from millions of devices with potentially unreliable or limited communication and…

Machine Learning · Computer Science 2020-11-24 Farzin Haddadpour , Mohammad Mahdi Kamani , Aryan Mokhtari , Mehrdad Mahdavi

Quantum Federated Learning (QFL) inherits the core vulnerability of federated optimization to malicious clients, while also introducing an attack surface from variational circuit training and measurement-driven gradients. This work proposes…

Quantum Physics · Physics 2026-05-28 Aakar Mathur , Mohammed Ruknuddin , Ashish Gupta

Federated learning enables learning from decentralized data sources without compromising privacy, which makes it a crucial technique. However, it is vulnerable to model poisoning attacks, where malicious clients interfere with the training…

Cryptography and Security · Computer Science 2023-07-19 Sungwon Park , Sungwon Han , Fangzhao Wu , Sundong Kim , Bin Zhu , Xing Xie , Meeyoung Cha

We consider the problem of adversarial bandit convex optimization, that is, online learning over a sequence of arbitrary convex loss functions with only one function evaluation for each of them. While all previous works assume known and…

Machine Learning · Computer Science 2022-02-15 Haipeng Luo , Mengxiao Zhang , Peng Zhao