English
Related papers

Related papers: Position: Federated Foundation Language Model Post…

200 papers

Federated learning involves training statistical models over edge devices such as mobile phones such that the training data is kept local. Federated Learning (FL) can serve as an ideal candidate for training spatial temporal models that…

Machine Learning · Computer Science 2024-02-09 Yacine Belal , Sonia Ben Mokhtar , Hamed Haddadi , Jaron Wang , Afra Mashhadi

Federated learning (FL), an effective distributed machine learning framework, implements model training and meanwhile protects local data privacy. It has been applied to a broad variety of practice areas due to its great performance and…

Cryptography and Security · Computer Science 2023-03-21 Jinyin Chen , Mingjun Li , Mingjun Li , Haibin Zheng

With increasing privacy concerns on data, recent studies have made significant progress using federated learning (FL) on privacy-sensitive natural language processing (NLP) tasks. Much literature suggests fully fine-tuning pre-trained…

Machine Learning · Computer Science 2023-06-05 Zhuo Zhang , Yuanhang Yang , Yong Dai , Lizhen Qu , Zenglin Xu

Since the advent of Federated Learning (FL), research has applied these methods to natural language processing (NLP) tasks. Despite a plethora of papers in FL for NLP, no previous works have studied how multilingual text impacts FL…

Computation and Language · Computer Science 2022-06-07 Orion Weller , Marc Marone , Vladimir Braverman , Dawn Lawrie , Benjamin Van Durme

Federated Learning (FL) has emerged as a transformative paradigm in the field of distributed machine learning, enabling multiple clients such as mobile devices, edge nodes, or organizations to collaboratively train a shared global model…

Machine Learning · Computer Science 2026-03-09 Ratun Rahman

Federated Learning (FL) represents a significant advancement in distributed machine learning, enabling multiple participants to collaboratively train models without sharing raw data. This decentralized approach enhances privacy by keeping…

Cryptography and Security · Computer Science 2025-02-10 Jaydip Sen , Hetvi Waghela , Sneha Rakshit

Federated learning (FL) addresses data privacy concerns by enabling collaborative training of AI models across distributed data owners. Wide adoption of FL faces the fundamental challenges of data heterogeneity and the large scale of data…

Machine Learning · Computer Science 2023-08-23 Yulan Gao , Zhaoxiang Hou , Chengyi Yang , Zengxiang Li , Han Yu

It is commonplace to produce application-specific models by fine-tuning large pre-trained models using a small bespoke dataset. The widespread availability of foundation model checkpoints on the web poses considerable risks, including the…

Cryptography and Security · Computer Science 2024-04-02 Yuxin Wen , Leo Marchyok , Sanghyun Hong , Jonas Geiping , Tom Goldstein , Nicholas Carlini

When personalized federated learning (FL) meets large foundation models, new challenges arise from various limitations in resources. In addition to typical limitations such as data, computation, and communication costs, access to the models…

Artificial Intelligence · Computer Science 2023-10-10 Wang Lu , Hao Yu , Jindong Wang , Damien Teney , Haohan Wang , Yiqiang Chen , Qiang Yang , Xing Xie , Xiangyang Ji

Federated learning (FL) is an emerging paradigm of collaborative machine learning that preserves user privacy while building powerful models. Nevertheless, due to the nature of open participation by self-interested entities, it needs to…

Cryptography and Security · Computer Science 2022-02-18 Yanci Zhang , Han Yu

Increasing privacy concerns and unrestricted access to data lead to the development of a novel machine learning paradigm called Federated Learning (FL). FL borrows many of the ideas from distributed machine learning, however, the challenges…

Machine Learning · Computer Science 2025-01-08 Karthik Mohan

A key promise of machine learning is the ability to assist users with personal tasks. Because the personal context required to make accurate predictions is often sensitive, we require systems that protect privacy. A gold standard…

Machine Learning · Computer Science 2023-02-03 Simran Arora , Christopher Ré

Federated learning (FL) is a framework for training machine learning models in a distributed and collaborative manner. During training, a set of participating clients process their data stored locally, sharing only the model updates…

Machine Learning · Computer Science 2023-10-31 Filippo Galli , Kangsoo Jung , Sayan Biswas , Catuscia Palamidessi , Tommaso Cucinotta

Increasing concerns and regulations about data privacy and sparsity necessitate the study of privacy-preserving, decentralized learning methods for natural language processing (NLP) tasks. Federated learning (FL) provides promising…

As data are increasingly being stored in different silos and societies becoming more aware of data privacy issues, the traditional centralized training of artificial intelligence (AI) models is facing efficiency and privacy challenges.…

Cryptography and Security · Computer Science 2022-01-20 Lingjuan Lyu , Han Yu , Xingjun Ma , Chen Chen , Lichao Sun , Jun Zhao , Qiang Yang , Philip S. Yu

Federated Learning (FL) enables distributed machine learning training while preserving privacy, representing a paradigm shift for data-sensitive and decentralized environments. Despite its rapid advancements, FL remains a complex and…

Machine Learning · Computer Science 2025-05-14 Frederico Vicente , Cláudia Soares , Dušan Jakovetić

Federated Learning (FL) has emerged as a promising approach to address data privacy and confidentiality concerns by allowing multiple participants to construct a shared model without centralizing sensitive data. However, this decentralized…

Cryptography and Security · Computer Science 2023-07-25 Jahid Hasan

Despite impressive results, deep learning-based technologies also raise severe privacy and environmental concerns induced by the training procedure often conducted in data centers. In response, alternatives to centralized training such as…

Advancement in the field of machine learning is unavoidable, but something of major concern is preserving the privacy of the users whose data is being used for training these machine learning algorithms. Federated learning(FL) has emerged…

Machine Learning · Computer Science 2023-11-07 Ishmeet Kaur , Adwaita Janardhan Jadhav

Personalization methods in federated learning aim to balance the benefits of federated and local training for data availability, communication cost, and robustness to client heterogeneity. Approaches that require clients to communicate all…

Machine Learning · Computer Science 2022-04-28 Karan Singhal , Hakim Sidahmed , Zachary Garrett , Shanshan Wu , Keith Rush , Sushant Prakash