中文
相关论文

相关论文: Measuring the Effects of Non-Identical Data Distri…

200 篇论文

In this paper, we investigate the effect of data heterogeneity across clients on the performance of distributed learning systems, i.e., one-round Federated Learning, as measured by the associated generalization error. Specifically, $K$…

机器学习 · 计算机科学 2025-05-21 Masoud Kavian , Romain Chor , Milad Sefidgaran , Abdellatif Zaidi

Federated learning, which allows multiple client devices in a network to jointly train a machine learning model without direct exposure of clients' data, is an emerging distributed learning technique due to its nature of privacy…

机器学习 · 计算机科学 2023-03-22 Jing Zhang , Chuanwen Li , Jianzgong Qi , Jiayuan He

Federated learning is a privacy-preserving machine learning technique that learns a shared model across decentralized clients. It can alleviate privacy concerns of personal re-identification, an important computer vision task. In this work,…

计算机视觉与模式识别 · 计算机科学 2020-10-12 Weiming Zhuang , Yonggang Wen , Xuesen Zhang , Xin Gan , Daiying Yin , Dongzhan Zhou , Shuai Zhang , Shuai Yi

As people pay more and more attention to privacy protection, Federated Learning (FL), as a promising distributed machine learning paradigm, is receiving more and more attention. However, due to the biased distribution of data on devices in…

机器学习 · 计算机科学 2023-02-27 Yuquan Zhang , Yongquan Zhang

Federated Learning (FL) is a privacy preserving machine learning scheme, where training happens with data federated across devices and not leaving them to sustain user privacy. This is ensured by making the untrained or partially trained…

In the field of federated learning, addressing non-independent and identically distributed (non-i.i.d.) data remains a quintessential challenge for improving global model performance. This work introduces the Feature Norm Regularized…

机器学习 · 计算机科学 2023-12-13 Ke Hu , WeiDong Qiu , Peng Tang

Federated learning (FL) is a promising technique that enables a large amount of edge computing devices to collaboratively train a global learning model. Due to privacy concerns, the raw data on devices could not be available for centralized…

机器学习 · 计算机科学 2020-11-24 Miao Yang , Akitanoshou Wong , Hongbin Zhu , Haifeng Wang , Hua Qian

One of the challenges in federated learning is the non-independent and identically distributed (non-iid) characteristics between heterogeneous devices, which cause significant differences in local updates and affect the performance of the…

机器学习 · 计算机科学 2023-04-03 Chenxi Huang , Liang Xie , Yibo Yang , Wenxiao Wang , Binbin Lin , Deng Cai

This paper studies federated learning for nonparametric regression in the context of distributed samples across different servers, each adhering to distinct differential privacy constraints. The setting we consider is heterogeneous,…

统计理论 · 数学 2024-06-12 T. Tony Cai , Abhinav Chakraborty , Lasse Vuursteen

Federated learning is a distributed machine learning method that aims to preserve the privacy of sample features and labels. In a federated learning system, ID-based sample alignment approaches are usually applied with few efforts made on…

密码学与安全 · 计算机科学 2020-06-12 Yang Liu , Xiong Zhang , Libin Wang

We investigate contrastive learning in the federated setting through the lens of SimCLR and multi-view mutual information maximization. In doing so, we uncover a connection between contrastive representation learning and user verification;…

机器学习 · 计算机科学 2024-05-06 Christos Louizos , Matthias Reisser , Denis Korzhenkov

Federated Learning (FL) is a collaborative method for training models while preserving data privacy in decentralized settings. However, FL encounters challenges related to data heterogeneity, which can result in performance degradation. In…

机器学习 · 计算机科学 2023-11-23 Seongyoon Kim , Gihun Lee , Jaehoon Oh , Se-Young Yun

Classical federated learning approaches yield significant performance degradation in the presence of Non-IID data distributions of participants. When the distribution of each local dataset is highly different from the global one, the local…

机器学习 · 计算机科学 2022-08-23 Mahdi Morafah , Saeed Vahidian , Weijia Wang , Bill Lin

Federated Learning (FL) is a decentralized approach for collaborative model training on edge devices. This distributed method of model training offers advantages in privacy, security, regulatory compliance, and cost-efficiency. Our emphasis…

机器学习 · 计算机科学 2024-10-24 Charuka Herath , Xiaolan Liu , Sangarapillai Lambotharan , Yogachandran Rahulamathavan

Federated learning has received great attention for its capability to train a large-scale model in a decentralized manner without needing to access user data directly. It helps protect the users' private data from centralized collecting.…

机器学习 · 计算机科学 2023-02-07 Guodong Long , Ming Xie , Tao Shen , Tianyi Zhou , Xianzhi Wang , Jing Jiang , Chengqi Zhang

Many image and vision applications require a large amount of data for model training. Collecting all such data at a central location can be challenging due to data privacy and communication bandwidth restrictions. Federated learning is an…

机器学习 · 计算机科学 2020-06-24 Tiffany Tuor , Shiqiang Wang , Bong Jun Ko , Changchang Liu , Kin K. Leung

Federated Learning (FL) has become an active and promising distributed machine learning paradigm. As a result of statistical heterogeneity, recent studies clearly show that the performance of popular FL methods (e.g., FedAvg) deteriorates…

机器学习 · 计算机科学 2021-06-24 Hua Huang , Fanhua Shang , Yuanyuan Liu , Hongying Liu

Federated learning (FL) typically faces data heterogeneity, i.e., distribution shifting among clients. Sharing clients' information has shown great potentiality in mitigating data heterogeneity, yet incurs a dilemma in preserving privacy…

机器学习 · 计算机科学 2023-10-12 Zhiqin Yang , Yonggang Zhang , Yu Zheng , Xinmei Tian , Hao Peng , Tongliang Liu , Bo Han

Heterogeneity arising from label distribution skew and data scarcity can cause inaccuracy and unfairness in intelligent communication applications that heavily rely on distributed computing. To deal with it, this paper proposes a novel…

机器学习 · 计算机科学 2025-09-18 Chenghao Huang , Xiaolu Chen , Yanru Zhang , Hao Wang

As privacy concerns and data regulations grow, federated learning (FL) has emerged as a promising approach for training machine learning models across decentralized data sources without sharing raw data. However, a significant challenge in…

机器学习 · 计算机科学 2025-06-04 Jungwon Seo , Ferhat Ozgur Catak , Chunming Rong