English
Related papers

Related papers: Federated Learning Meets Natural Language Processi…

200 papers

Private data, being larger and quality-higher than public data, can greatly improve large language models (LLM). However, due to privacy concerns, this data is often dispersed in multiple silos, making its secure utilization for LLM…

Cryptography and Security · Computer Science 2024-12-24 JiaYing Zheng , HaiNan Zhang , LingXiang Wang , WangJie Qiu , HongWei Zheng , ZhiMing Zheng

Federated Learning (FL) is a promising distributed method for edge-level machine learning, particularly for privacysensitive applications such as those in military and medical domains, where client data cannot be shared or transferred to a…

Machine Learning · Computer Science 2024-06-27 Lucas Grativol Ribeiro , Mathieu Leonardon , Guillaume Muller , Virginie Fresse , Matthieu Arzel

Deep neural networks have shown the ability to extract universal feature representations from data such as images and text that have been useful for a variety of learning tasks. However, the fruits of representation learning have yet to be…

Machine Learning · Computer Science 2023-03-28 Liam Collins , Hamed Hassani , Aryan Mokhtari , Sanjay Shakkottai

With the wealth of information produced by social networks, smartphones, medical or financial applications, speculations have been raised about the sensitivity of such data in terms of users' personal privacy and data security. To address…

Machine Learning · Computer Science 2019-08-21 Vito Walter Anelli , Yashar Deldjoo , Tommaso Di Noia , Antonio Ferrara

Federated learning becomes increasingly attractive in the areas of wireless communications and machine learning due to its powerful functions and potential applications. In contrast to other machine learning tools that require no…

Information Theory · Computer Science 2020-05-13 Zhijin Qin , Geoffrey Ye Li , Hao Ye

Federated learning has been rapidly evolving and gaining popularity in recent years due to its privacy-preserving features, among other advantages. Nevertheless, the exchange of model updates and gradients in this architecture provides new…

Cryptography and Security · Computer Science 2024-03-20 Ehsan Hallaji , Roozbeh Razavi-Far , Mehrdad Saif , Boyu Wang , Qiang Yang

Federated learning (FL) is a framework for machine learning across heterogeneous client devices in a privacy-preserving fashion. To date, most FL algorithms learn a "global" server model across multiple rounds. At each round, the same…

Machine Learning · Computer Science 2022-08-22 Zachary Charles , Kallista Bonawitz , Stanislav Chiknavaryan , Brendan McMahan , Blaise Agüera y Arcas

In the past few decades, machine learning has revolutionized data processing for large scale applications. Simultaneously, increasing privacy threats in trending applications led to the redesign of classical data training models. In…

Machine Learning · Computer Science 2021-07-26 Muhammad Asad , Ahmed Moustafa , Takayuki Ito

Federated learning (FL) addresses privacy concerns in training language models by enabling multiple clients to contribute to the training, without sending their data to others. However, non-IID (identically and independently distributed)…

Machine Learning · Computer Science 2025-01-28 Jong-Ik Park , Carlee Joe-Wong

Federated Learning is a new machine learning paradigm dealing with distributed model learning on independent devices. One of the many advantages of federated learning is that training data stay on devices (such as smartphones), and only…

Machine Learning · Computer Science 2022-07-19 Sannara Ek , Romain Rombourg , François Portet , Philippe Lalanda

Federated learning (FL) as distributed machine learning has gained popularity as privacy-aware Machine Learning (ML) systems have emerged as a technique that prevents privacy leakage by building a global model and by conducting…

Cryptography and Security · Computer Science 2023-07-17 Taki Hasan Rafi , Faiza Anan Noor , Tahmid Hussain , Dong-Kyu Chae

Large Language Models (LLMs) have demonstrated impressive success across various tasks. Integrating LLMs with Federated Learning (FL), a paradigm known as FedLLM, offers a promising avenue for collaborative model adaptation while preserving…

Machine Learning · Computer Science 2026-02-25 Yebo Wu , Chunlin Tian , Jingguang Li , He Sun , Kahou Tam , Zhanting Zhou , Haicheng Liao , Jing Xiong , Zhijiang Guo , Li Li , Chengzhong Xu

Federated learning plays an important role in the process of smart cities. With the development of big data and artificial intelligence, there is a problem of data privacy protection in this process. Federated learning is capable of solving…

Machine Learning · Computer Science 2021-03-16 Zhaohua Zheng , Yize Zhou , Yilong Sun , Zhang Wang , Boyi Liu , Keqiu Li

Federated learning (FL) is a kind of distributed machine learning framework, where the global model is generated on the centralized aggregation server based on the parameters of local models, addressing concerns about privacy leakage caused…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-22 Chenhao Xu , Youyang Qu , Yong Xiang , Longxiang Gao

Federated learning (FL) is a promising technique that enables a large amount of edge computing devices to collaboratively train a global learning model. Due to privacy concerns, the raw data on devices could not be available for centralized…

Machine Learning · Computer Science 2020-11-24 Miao Yang , Akitanoshou Wong , Hongbin Zhu , Haifeng Wang , Hua Qian

Federated learning (FL) is a novel distributed machine learning paradigm that enables participants to collaboratively train a centralized model with privacy preservation by eliminating the requirement of data sharing. In practice, FL often…

Machine Learning · Computer Science 2024-03-05 Wei Guo , Fuzhen Zhuang , Xiao Zhang , Yiqi Tong , Jin Dong

As an emerging technique, Federated Learning (FL) can jointly train a global model with the data remaining locally, which effectively solves the problem of data privacy protection through the encryption mechanism. The clients train their…

Machine Learning · Computer Science 2020-12-04 Yi Liu , Li Zhang , Ning Ge , Guanghao Li

Federated learning (FL) is an effective solution to train machine learning models on the increasing amount of data generated by IoT devices and smartphones while keeping such data localized. Most previous work on federated learning assumes…

Machine Learning · Computer Science 2023-01-05 Othmane Marfoq , Giovanni Neglia , Laetitia Kameni , Richard Vidal

Federated Learning (FL) is a distributed machine learning technique, where each device contributes to the learning model by independently computing the gradient based on its local training data. It has recently become a hot research topic,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-28 Afaf Taïk , Soumaya Cherkaoui

The reliance of language model training on massive amounts of computation and vast datasets scraped from potentially low-quality, copyrighted, or sensitive data has come into question practically, legally, and ethically. Federated learning…

Machine Learning · Computer Science 2024-05-28 Alex Iacob , Lorenzo Sani , Bill Marino , Preslav Aleksandrov , William F. Shen , Nicholas Donald Lane