English
Related papers

Related papers: Federated Learning Hyper-Parameter Tuning from a S…

200 papers

Federated Learning (FL) is a way for machines to learn from data that is kept locally, in order to protect the privacy of clients. This is typically done using local SGD, which helps to improve communication efficiency. However, such a…

Machine Learning · Computer Science 2023-06-01 Yongxin Guo , Xiaoying Tang , Tao Lin

Federated learning (FL) is a privacy-preserving learning technique that enables distributed computing devices to train shared learning models across data silos collaboratively. Existing FL works mostly focus on designing advanced FL…

Machine Learning · Computer Science 2023-02-20 Yash Travadi , Le Peng , Xuan Bi , Ju Sun , Mochen Yang

Instruction tuning has been identified as a crucial technique for optimizing the performance of large language models (LLMs) in generating human-aligned responses. Nonetheless, gathering diversified and superior-quality instruction data for…

Cryptography and Security · Computer Science 2024-06-21 Zhuo Zhang , Jingyuan Zhang , Jintao Huang , Lizhen Qu , Hongzhi Zhang , Qifan Wang , Xun Zhou , Zenglin Xu

Efficient deployment of deep neural networks across many devices and resource constraints, particularly on edge devices, is one of the most challenging problems in the presence of data-privacy preservation issues. Conventional approaches…

Machine Learning · Computer Science 2022-10-07 Taehyeon Kim , Se-Young Yun

Over the past few years, Federated Learning (FL) has become an emerging machine learning technique to tackle data privacy challenges through collaborative training. In the Federated Learning algorithm, the clients submit a locally trained…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-22 Tiantian Feng , Digbalay Bose , Tuo Zhang , Rajat Hebbar , Anil Ramakrishna , Rahul Gupta , Mi Zhang , Salman Avestimehr , Shrikanth Narayanan

Federated learning (FL) is a promising technique for addressing the rising privacy and security issues. Its main ingredient is to cooperatively learn the model among the distributed clients without uploading any sensitive data. In this…

Artificial Intelligence · Computer Science 2023-03-07 Huiming Chen , Huandong Wang , Qingyue Long , Depeng Jin , Yong Li

Personalized Federated Learning (PFL) which collaboratively trains a federated model while considering local clients under privacy constraints has attracted much attention. Despite its popularity, it has been observed that existing PFL…

Machine Learning · Computer Science 2022-12-05 Tianchun Wang , Wei Cheng , Dongsheng Luo , Wenchao Yu , Jingchao Ni , Liang Tong , Haifeng Chen , Xiang Zhang

Large Language Models (LLMs) have gained prominence in the field of Legal Intelligence, offering potential applications in assisting legal professionals and laymen. However, the centralized training of these Legal LLMs raises data privacy…

Computation and Language · Computer Science 2024-04-11 Linan Yue , Qi Liu , Yichao Du , Weibo Gao , Ye Liu , Fangzhou Yao

Pre-trained Language Models (PLMs) have demonstrated impressive performance in various NLP tasks. However, traditional fine-tuning methods for leveraging PLMs for downstream tasks entail significant computational overhead. Prompt-tuning has…

Machine Learning · Computer Science 2025-07-29 Ali Shakeri , Wei Emma Zhang , Amin Beheshti , Weitong Chen , Jian Yang , Lishan Yang

Federated learning (FL) refers to a distributed machine learning framework involving learning from several decentralized edge clients without sharing local dataset. This distributed strategy prevents data leakage and enables on-device…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-28 Taki Hasan Rafi , Faiza Anan Noor , Tahmid Hussain , Dong-Kyu Chae , Zhaohui Yang

Federated Learning (FL) is a machine-learning approach enabling collaborative model training across multiple decentralized edge devices that hold local data samples, all without exchanging these samples. This collaborative process occurs…

Machine Learning · Computer Science 2024-01-02 Venkataraman Natarajan Iyer

Federated Learning (FL) is a decentralized model training approach that preserves data privacy but struggles with low efficiency. Quantization, a powerful training optimization technique, has been widely explored for integration into FL.…

Machine Learning · Computer Science 2025-05-20 Zihao Zheng , Ziyao Wang , Xiuping Cui , Maoliang Li , Jiayu Chen , Yun , Liang , Ang Li , Xiang Chen

Federated learning (FL) provides a distributed learning framework for multiple participants to collaborate learning without sharing raw data. In many practical FL scenarios, participants have heterogeneous resources due to disparities in…

Machine Learning · Computer Science 2022-03-21 Junyuan Hong , Haotao Wang , Zhangyang Wang , Jiayu Zhou

The increasing demand for privacy-preserving collaborative learning has given rise to a new computing paradigm called federated learning (FL), in which clients collaboratively train a machine learning (ML) model without revealing their…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-31 Zhifeng Jiang , Wei Wang , Bo Li , Qiang Yang

Federated Learning (FL) requires frequent exchange of model parameters, which leads to long communication delay, especially when the network environments of clients vary greatly. Moreover, the parameter server needs to wait for the slowest…

Machine Learning · Computer Science 2024-04-09 Zhiying Feng , Xu Chen , Qiong Wu , Wen Wu , Xiaoxi Zhang , Qianyi Huang

Federated Learning (FL) enables collaborative learning across distributed clients while preserving data privacy. However, FL faces significant challenges when dealing with heterogeneous data distributions, which can lead to suboptimal…

Machine Learning · Computer Science 2025-03-11 Duy Phuong Nguyen , J. Pablo Munoz , Tanya Roosta , Ali Jannesari

The performance of Transfer Learning (TL) heavily relies on effective pretraining, which demands large datasets and substantial computational resources. As a result, executing TL is often challenging for individual model developers.…

Machine Learning · Computer Science 2024-10-18 Evelyn Ma , Chao Pan , Rasoul Etesami , Han Zhao , Olgica Milenkovic

Federated Learning (FL) is a distributed machine learning paradigm that enables learning models from decentralized local data. While FL offers appealing properties for clients' data privacy, it imposes high communication burdens for…

Machine Learning · Computer Science 2023-11-17 Saeed Khalilian , Vasileios Tsouvalas , Tanir Ozcelebi , Nirvana Meratnia

Federated learning (FL) is a recently developed area of machine learning, in which the private data of a large number of distributed clients is used to develop a global model under the coordination of a central server without explicitly…

Machine Learning · Computer Science 2022-07-21 Amit Kumar Kundu , Joseph Jaja

Federated Learning (FL) is a privacy preserving machine learning scheme, where training happens with data federated across devices and not leaving them to sustain user privacy. This is ensured by making the untrained or partially trained…