中文
相关论文

相关论文: Federated Customization of Large Models: Approache…

200 篇论文

Pre-trained large language models (LLMs) need fine-tuning to improve their responsiveness to natural language instructions. Federated learning offers a way to fine-tune LLMs using the abundant data on end devices without compromising data…

机器学习 · 计算机科学 2024-05-28 Zhen Qin , Daoyuan Chen , Bingchen Qian , Bolin Ding , Yaliang Li , Shuiguang Deng

This paper focuses on addressing the practical yet challenging problem of model heterogeneity in federated learning, where clients possess models with different network structures. To track this problem, we propose a novel framework called…

机器学习 · 计算机科学 2023-10-30 Jiaqi Wang , Xingyi Yang , Suhan Cui , Liwei Che , Lingjuan Lyu , Dongkuan Xu , Fenglong Ma

Federated learning (FL) is a distributed learning framework that leverages commonalities between distributed client datasets to train a global model. Under heterogeneous clients, however, FL can fail to produce stable training results.…

机器学习 · 计算机科学 2024-11-04 Connor J. Mclaughlin , Lili Su

Data heterogeneity is one of the most challenging issues in federated learning, which motivates a variety of approaches to learn personalized models for participating clients. One such approach in deep neural networks based tasks is…

机器学习 · 计算机科学 2023-06-22 Jian Xu , Xinyi Tong , Shao-Lun Huang

Federated learning is a new learning paradigm that decouples data collection and model training via multi-party computation and model aggregation. As a flexible learning setting, federated learning has the potential to integrate with other…

机器学习 · 计算机科学 2024-05-15 Shaoxiong Ji , Yue Tan , Teemu Saravirta , Zhiqin Yang , Yixin Liu , Lauri Vasankari , Shirui Pan , Guodong Long , Anwar Walid

Recent advancements in federated learning (FL) seek to increase client-level performance by fine-tuning client parameters on local data or personalizing architectures for the local task. Existing methods for such personalization either…

机器学习 · 计算机科学 2024-06-11 Rishub Tamirisa , John Won , Chengjun Lu , Ron Arel , Andy Zhou

The increasing demand for privacy-preserving machine learning has spurred interest in federated unlearning, which enables the selective removal of data from models trained in federated systems. However, developing federated unlearning…

机器学习 · 计算机科学 2025-05-19 Yang Zhao , Jiaxi Yang , Yiling Tao , Lixu Wang , Xiaoxiao Li , Dusit Niyato , H. Vincent Poor

Most existing personalized federated learning approaches are based on intricate designs, which often require complex implementation and tuning. In order to address this limitation, we propose a simple yet effective personalized federated…

分布式、并行与集群计算 · 计算机科学 2024-01-30 Jiaqi Wang , Yuzhong Chen , Yuhang Wu , Mahashweta Das , Hao Yang , Fenglong Ma

Federated learning allows a large number of devices to jointly learn a model without sharing data. In this work, we enable clients with limited computing power to perform action recognition, a computationally heavy task. We first perform…

分布式、并行与集群计算 · 计算机科学 2021-07-27 Pranjal Jain , Shreyas Goenka , Saurabh Bagchi , Biplab Banerjee , Somali Chaterji

Federated Learning is a machine learning paradigm where we aim to train machine learning models in a distributed fashion. Many clients/edge devices collaborate with each other to train a single model on the central. Clients do not share…

机器学习 · 计算机科学 2022-11-28 Mann Patel

Federated machine learning is growing fast in academia and industries as a solution to solve data hungriness and privacy issues in machine learning. Being a widely distributed system, federated machine learning requires various system…

机器学习 · 计算机科学 2023-05-01 Sin Kit Lo , Qinghua Lu , Hye-Young Paik , Liming Zhu

We study a new form of federated learning where the clients train personalized local models and make predictions jointly with the server-side shared model. Using this new federated learning framework, the complexity of the central shared…

机器学习 · 计算机科学 2020-03-31 Alekh Agarwal , John Langford , Chen-Yu Wei

Federated learning is an emerging technique used to prevent the leakage of private information. Unlike centralized learning that needs to collect data from users and store them collectively on a cloud server, federated learning makes it…

机器学习 · 计算机科学 2019-06-11 Hangyu Zhu , Yaochu Jin

Federated learning is proposed as a machine learning setting to enable distributed edge devices, such as mobile phones, to collaboratively learn a shared prediction model while keeping all the training data on device, which can not only…

机器学习 · 计算机科学 2020-03-13 Lifeng Liu , Fengda Zhang , Jun Xiao , Chao Wu

We consider two federated learning algorithms for training partially personalized models, where the shared and personal parameters are updated either simultaneously or alternately on the devices. Both algorithms have been proposed in the…

机器学习 · 计算机科学 2022-08-17 Krishna Pillutla , Kshitiz Malik , Abdelrahman Mohamed , Michael Rabbat , Maziar Sanjabi , Lin Xiao

Artificial intelligence (AI) has demonstrated considerable potential in the realm of medical imaging. However, the development of high-performance AI models typically necessitates training on large-scale, centralized datasets. This approach…

密码学与安全 · 计算机科学 2025-08-29 Mengyu Sun , Ziyuan Yang , Yongqiang Huang , Hui Yu , Yingyu Chen , Shuren Qi , Andrew Beng Jin Teoh , Yi Zhang

Federated recommendations leverage the federated learning (FL) techniques to make privacy-preserving recommendations. Though recent success in the federated recommender system, several vital challenges remain to be addressed: (i) The…

信息检索 · 计算机科学 2022-08-25 Sichun Luo , Yuanzhang Xiao , Yang Liu , Congduan Li , Linqi Song

Federated learning (FL) research has made progress in developing algorithms for distributed learning of global models, as well as algorithms for local personalization of those common models to the specifics of each client's local data…

机器学习 · 计算机科学 2023-10-05 Royson Lee , Minyoung Kim , Da Li , Xinchi Qiu , Timothy Hospedales , Ferenc Huszár , Nicholas D. Lane

Federated learning enables distributed clients to collaborate on training while storing their data locally to protect client privacy. However, due to the heterogeneity of data, models, and devices, the final global model may need to perform…

机器学习 · 计算机科学 2024-06-25 Wolong Xing , Zhenkui Shi , Hongyan Peng , Xiantao Hu , Xianxian Li

Federated learning (FL) is a novel machine learning setting that enables on-device intelligence via decentralized training and federated optimization. Deep neural networks' rapid development facilitates the learning techniques for modeling…

机器学习 · 计算机科学 2021-09-27 Shaoxiong Ji , Wenqi Jiang , Anwar Walid , Xue Li