中文
相关论文

相关论文: Federated Hyperparameter Tuning: Challenges, Basel…

200 篇论文

Foundation models have revolutionized artificial intelligence by providing robust, versatile architectures pre-trained on large-scale datasets. However, adapting these massive models to specific downstream tasks requires fine-tuning, which…

机器学习 · 计算机科学 2025-05-01 Jieming Bian , Yuanzhe Peng , Lei Wang , Yin Huang , Jie Xu

Federated learning enables many local devices to train a deep learning model jointly without sharing the local data. Currently, most of federated training schemes learns a global model by averaging the parameters of local models. However,…

机器学习 · 计算机科学 2021-10-26 Zhenwei Dai , Chen Dun , Yuxin Tang , Anastasios Kyrillidis , Anshumali Shrivastava

Federated learning is a distributed machine learning approach in which a single server and multiple clients collaboratively build machine learning models without sharing datasets on clients. A challenging issue of federated learning is data…

机器学习 · 计算机科学 2022-06-28 Koji Matsuda , Yuya Sasaki , Chuan Xiao , Makoto Onizuka

In Federated Learning, we aim to train models across multiple computing units (users), while users can only communicate with a common central server, without exchanging their data samples. This mechanism exploits the computational power of…

机器学习 · 计算机科学 2020-10-26 Alireza Fallah , Aryan Mokhtari , Asuman Ozdaglar

The emerging paradigm of federated learning (FL) strives to enable collaborative training of deep models on the network edge without centrally aggregating raw data and hence improving data privacy. In most cases, the assumption of…

机器学习 · 计算机科学 2021-05-12 Xiaoxiao Li , Meirui Jiang , Xiaofei Zhang , Michael Kamp , Qi Dou

We study a hierarchical federated learning (FL) problem, where clients cooperatively seek to select among multiple optimal solutions of a primary distributed learning problem, a solution that minimizes a secondary loss function. This…

最优化与控制 · 数学 2026-05-26 Mohammadjavad Ebrahimi , Yuyang Qiu , Shisheng Cui , Farzad Yousefian

Federated learning is a distributed machine learning approach where multiple clients collaboratively train a model without sharing their local data, which contributes to preserving privacy. A challenge in federated learning is managing…

机器学习 · 计算机科学 2025-03-04 Rickard Brännvall

Performance degradation owing to data heterogeneity and low output interpretability are the most significant challenges faced by federated learning in practical applications. Personalized federated learning diverges from traditional…

机器学习 · 计算机科学 2024-02-28 Mengen Luo , Chi Xu , Ercan Engin Kuruoglu

With increasing privacy concerns on data, recent studies have made significant progress using federated learning (FL) on privacy-sensitive natural language processing (NLP) tasks. Much literature suggests fully fine-tuning pre-trained…

机器学习 · 计算机科学 2023-06-05 Zhuo Zhang , Yuanhang Yang , Yong Dai , Lizhen Qu , Zenglin Xu

Federated learning (FL) has attracted increasing attention in recent years. As a privacy-preserving collaborative learning paradigm, it enables a broader range of applications, especially for computer vision and natural language processing…

机器学习 · 计算机科学 2020-11-24 Yilun Lin , Chaochao Chen , Cen Chen , Li Wang

Federated learning is a machine learning training paradigm that enables clients to jointly train models without sharing their own localized data. However, the implementation of federated learning in practice still faces numerous challenges,…

机器学习 · 计算机科学 2023-04-21 Yujia Wang , Lu Lin , Jinghui Chen

Federated learning (FL) enables distributed devices to collaboratively train machine learning models while maintaining data privacy. However, the heterogeneous hardware capabilities of devices often result in significant training delays, as…

机器学习 · 计算机科学 2025-09-23 Letian Zhang , Bo Chen , Jieming Bian , Lei Wang , Jie Xu

There is an increasing interest in a fast-growing machine learning technique called Federated Learning, in which the model training is distributed over mobile user equipments (UEs), exploiting UEs' local computation and training data.…

Due to the curse of statistical heterogeneity across clients, adopting a personalized federated learning method has become an essential choice for the successful deployment of federated learning-based services. Among diverse branches of…

机器学习 · 计算机科学 2022-08-12 Seok-Ju Hahn , Minwoo Jeong , Junghye Lee

Federated learning is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. Standard federated optimization methods such as…

Machine learning algorithms have been used widely in various applications and areas. To fit a machine learning model into different problems, its hyper-parameters must be tuned. Selecting the best hyper-parameter configuration for machine…

机器学习 · 计算机科学 2022-10-06 Li Yang , Abdallah Shami

Federated learning has drawn widespread interest from researchers, yet the data heterogeneity across edge clients remains a key challenge, often degrading model performance. Existing methods enhance model compatibility with data…

机器学习 · 计算机科学 2026-01-06 Qiantao Yang , Liquan Chen , Mingfu Xue , Songze Li

The emergence of foundation models, including language and vision models, has reshaped AI's landscape, offering capabilities across various applications. Deploying and fine-tuning these large models, like GPT-3 and BERT, presents…

机器学习 · 计算机科学 2024-02-29 Terence Jie Chua , Wenhan Yu , Jun Zhao , Kwok-Yan Lam

Standard federated learning approaches suffer when client data distributions have sufficient heterogeneity. Recent methods addressed the client data heterogeneity issue via personalized federated learning (PFL) - a class of FL algorithms…

机器学习 · 计算机科学 2024-04-04 Rishub Tamirisa , Chulin Xie , Wenxuan Bao , Andy Zhou , Ron Arel , Aviv Shamsian

Data generated at the network edge can be processed locally by leveraging the paradigm of edge computing (EC). Aided by EC, decentralized federated learning (DFL), which overcomes the single-point-of-failure problem in the parameter server…

网络与互联网体系结构 · 计算机科学 2022-12-06 Yunming Liao , Yang Xu , Hongli Xu , Lun Wang , Chen Qian