English
Related papers

Related papers: FedPerfix: Towards Partial Model Personalization o…

200 papers

Personalized Federated Learning (PFL) relies on collective data knowledge to build customized models. However, non-IID data between clients poses significant challenges, as collaborating with clients who have diverse data distributions can…

Machine Learning · Computer Science 2024-01-01 Zihan Chen , Jundong Li , Cong Shen

Federated learning (FL) has emerged as a promising paradigm for fine-tuning foundation models using distributed data in a privacy-preserving manner. Under limited computational resources, clients often find it more practical to fine-tune a…

Machine Learning · Computer Science 2024-11-27 Yuchang Sun , Yuexiang Xie , Bolin Ding , Yaliang Li , Jun Zhang

Conventional methods for student modeling, which involve predicting grades based on measured activities, struggle to provide accurate results for minority/underrepresented student groups due to data availability biases. In this paper, we…

Federated learning (FL) enables collaboratively training deep learning models on decentralized data. However, there are three types of heterogeneities in FL setting bringing about distinctive challenges to the canonical federated learning…

Machine Learning · Computer Science 2020-09-18 Tao Shen , Jie Zhang , Xinkang Jia , Fengda Zhang , Gang Huang , Pan Zhou , Kun Kuang , Fei Wu , Chao Wu

Federated learning (FL) enables multiple sites to collaboratively train powerful deep models without compromising data privacy and security. The statistical heterogeneity (e.g., non-IID data and domain shifts) is a primary obstacle in FL,…

Image and Video Processing · Electrical Eng. & Systems 2023-04-13 Li Lin , Jiewei Wu , Yixiang Liu , Kenneth K. Y. Wong , Xiaoying Tang

Federated Learning (FL) is a privacy-protected machine learning paradigm that allows model to be trained directly at the edge without uploading data. One of the biggest challenges faced by FL in practical applications is the heterogeneity…

Machine Learning · Computer Science 2021-08-20 Zirui Zhu , Ziyi Ye

We present PeFLL, a new personalized federated learning algorithm that improves over the state-of-the-art in three aspects: 1) it produces more accurate models, especially in the low-data regime, and not only for clients present during its…

Machine Learning · Computer Science 2025-01-17 Jonathan Scott , Hossein Zakerinia , Christoph H. Lampert

Personalized subgraph Federated Learning (FL) is a task that customizes Graph Neural Networks (GNNs) to individual client needs, accommodating diverse data distributions. However, applying hypernetworks in FL, while aiming to facilitate…

Machine Learning · Computer Science 2024-06-03 Wenfei Liang , Yanan Zhao , Rui She , Yiming Li , Wee Peng Tay

Federated learning (FL) addresses data privacy concerns by enabling collaborative training of AI models across distributed data owners. Wide adoption of FL faces the fundamental challenges of data heterogeneity and the large scale of data…

Machine Learning · Computer Science 2023-08-23 Yulan Gao , Zhaoxiang Hou , Chengyi Yang , Zengxiang Li , Han Yu

Knowledge sharing and model personalization are two key components in the conceptual framework of personalized federated learning (PFL). Existing PFL methods focus on proposing new model personalization mechanisms while simply implementing…

Machine Learning · Computer Science 2022-05-03 Fengwen Chen , Guodong Long , Zonghan Wu , Tianyi Zhou , Jing Jiang

The advent of smart meters has enabled pervasive collection of energy consumption data for training short-term load forecasting models. In response to privacy concerns, federated learning (FL) has been proposed as a privacy-preserving…

Machine Learning · Computer Science 2024-04-03 Shourya Bose , Yu Zhang , Kibaek Kim

Personalized Federated Learning (pFL) not only can capture the common priors from broad range of distributed data, but also support customized models for heterogeneous clients. Researches over the past few years have applied the weighted…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-10 Xiaosong Ma , Jie Zhang , Song Guo , Wenchao Xu

Federated learning (FL) is a privacy preserving machine learning paradigm designed to collaboratively learn a global model without data leakage. Specifically, in a typical FL system, the central server solely functions as an coordinator to…

Machine Learning · Computer Science 2024-12-17 Hangyu Zhu , Yuxiang Fan , Zhenping Xie

Federated learning allows clients to collaboratively learn statistical models while keeping their data local. Federated learning was originally used to train a unique global model to be served to all clients, but this approach might be…

Machine Learning · Computer Science 2022-06-20 Othmane Marfoq , Giovanni Neglia , Laetitia Kameni , Richard Vidal

Federated Learning (FL), introduced in 2016, was designed to enhance data privacy in collaborative model training environments. Among the FL paradigm, horizontal FL, where clients share the same set of features but different data samples,…

In Federated Learning, we aim to train models across multiple computing units (users), while users can only communicate with a common central server, without exchanging their data samples. This mechanism exploits the computational power of…

Machine Learning · Computer Science 2020-10-26 Alireza Fallah , Aryan Mokhtari , Asuman Ozdaglar

The recent trend towards Personalized Federated Learning (PFL) has garnered significant attention as it allows for the training of models that are tailored to each client while maintaining data privacy. However, current PFL techniques…

Machine Learning · Computer Science 2023-05-03 Yue Wu , Shuaicheng Zhang , Wenchao Yu , Yanchi Liu , Quanquan Gu , Dawei Zhou , Haifeng Chen , Wei Cheng

Personalized federated learning is aimed at allowing numerous clients to train personalized models while participating in collaborative training in a communication-efficient manner without exchanging private data. However, many personalized…

Machine Learning · Computer Science 2022-10-28 Jaehee Jang , Heonseok Ha , Dahuin Jung , Sungroh Yoon

Federated Learning (FL) is a collaborative machine learning technique to train a global model without obtaining clients' private data. The main challenges in FL are statistical diversity among clients, limited computing capability among…

Machine Learning · Computer Science 2023-03-07 Xiaofeng Liu , Yinchuan Li , Qing Wang , Xu Zhang , Yunfeng Shao , Yanhui Geng

The popularity of federated learning (FL) is on the rise, along with growing concerns about data privacy in artificial intelligence applications. FL facilitates collaborative multi-party model learning while simultaneously ensuring the…

Machine Learning · Computer Science 2024-02-19 Muhammad Firdaus , Kyung-Hyune Rhee