English
Related papers

Related papers: Oblivionis: A Lightweight Learning and Unlearning …

200 papers

Large language models (LLMs) often necessitate extensive labeled datasets and training compute to achieve impressive performance across downstream tasks. This paper explores a self-training paradigm, where the LLM autonomously curates its…

Computation and Language · Computer Science 2024-11-13 Wei Jie Yeo , Teddy Ferdinan , Przemyslaw Kazienko , Ranjan Satapathy , Erik Cambria

Large Language Models (LLMs) have demonstrated impressive success across various tasks. Integrating LLMs with Federated Learning (FL), a paradigm known as FedLLM, offers a promising avenue for collaborative model adaptation while preserving…

Machine Learning · Computer Science 2026-02-25 Yebo Wu , Chunlin Tian , Jingguang Li , He Sun , Kahou Tam , Zhanting Zhou , Haicheng Liao , Jing Xiong , Zhijiang Guo , Li Li , Chengzhong Xu

In the age of cloud computing, data privacy protection has become a major challenge, especially when sharing sensitive data across cloud environments. However, how to optimize collaboration across cloud environments remains an unresolved…

Cryptography and Security · Computer Science 2025-05-20 Huaiying Luo , Cheng Ji

Large Language Models (LLMs) demonstrate remarkable capabilities, but their training on massive corpora poses significant risks from memorized sensitive information. To mitigate these issues and align with legal standards, unlearning has…

Computation and Language · Computer Science 2025-11-18 Ruichen Qiu , Jiajun Tan , Jiayue Pu , Honglin Wang , Xiao-Shan Gao , Fei Sun

Federated learning (FL), as a distributed collaborative machine learning (ML) framework under privacy-preserving constraints, has garnered increasing research attention in cross-organizational data collaboration scenarios. This paper…

Machine Learning · Computer Science 2025-10-31 Wenyou Guo , Ting Qu , Chunrong Pan , George Q. Huang

Federated Learning (FL) enables collaborative learning across distributed clients while preserving data privacy. However, FL faces significant challenges when dealing with heterogeneous data distributions, which can lead to suboptimal…

Machine Learning · Computer Science 2025-03-11 Duy Phuong Nguyen , J. Pablo Munoz , Tanya Roosta , Ali Jannesari

Federated Learning (FL) is a privacy-protected machine learning paradigm that allows model to be trained directly at the edge without uploading data. One of the biggest challenges faced by FL in practical applications is the heterogeneity…

Machine Learning · Computer Science 2021-08-20 Zirui Zhu , Ziyi Ye

Many application scenarios call for training a machine learning model among multiple participants. Federated learning (FL) was proposed to enable joint training of a deep learning model using the local data in each party without revealing…

Machine Learning · Computer Science 2021-02-12 Kai-Fung Chu , Lintao Zhang

Federated Learning Networks (FLNs) have been envisaged as a promising paradigm to collaboratively train models among mobile devices without exposing their local privacy data. Due to the need for frequent model updates and communications,…

Cryptography and Security · Computer Science 2021-10-07 Yuan-Ai Xie , Jiawen Kang , Dusit Niyato , Nguyen Thi Thanh Van , Nguyen Cong Luong , Zhixin Liu , Han Yu

With the widespread application of edge computing and cloud systems in AI-driven applications, how to maintain efficient performance while ensuring data privacy has become an urgent security issue. This paper proposes a federated…

Cryptography and Security · Computer Science 2025-06-24 Huaiying Luo , Cheng Ji

Federated learning (FL) is a distributed machine learning technique designed to preserve data privacy and security, and it has gained significant importance due to its broad range of applications. This paper addresses the problem of optimal…

Statistics Theory · Mathematics 2025-01-16 Tony Cai , Abhinav Chakraborty , Lasse Vuursteen

Federated Learning (FL) has emerged as a promising distributed learning paradigm with an added advantage of data privacy. With the growing interest in having collaboration among data owners, FL has gained significant attention of…

Machine Learning · Computer Science 2023-04-11 Afsana Khan , Marijn ten Thij , Anna Wilbik

Large language models trained on massive corpora of data from the web can memorize and reproduce sensitive or private data raising both legal and ethical concerns. Unlearning, or tuning models to forget information present in their training…

Machine Learning · Computer Science 2024-01-12 Pratyush Maini , Zhili Feng , Avi Schwarzschild , Zachary C. Lipton , J. Zico Kolter

Federated Learning (FL) enables collaborative training of models across distributed clients without sharing local data, addressing privacy concerns in decentralized systems. However, the gradient-sharing process exposes private data to…

Machine Learning · Computer Science 2025-03-11 Mingcong Xu , Xiaojin Zhang , Wei Chen , Hai Jin

This book offers a hands-on introduction to building and understanding federated learning (FL) systems. FL enables multiple devices -- such as smartphones, sensors, or local computers -- to collaboratively train machine learning (ML)…

Machine Learning · Computer Science 2025-06-11 A. Jung

Federated learning (FL) is a privacy-preserving machine learning framework that enables multiple nodes to train models on their local data and periodically average weight updates to benefit from other nodes' training. Each node's goal is to…

Machine Learning · Computer Science 2025-06-16 Ethan Wilson , Kai Yue , Chau-Wai Wong , Huaiyu Dai

In the realm of Artificial Intelligence (AI), the need for privacy and security in data processing has become paramount. As AI applications continue to expand, the collection and handling of sensitive data raise concerns about individual…

Federated Learning (FL) has emerged as a promising solution for collaborative training of large language models (LLMs). However, the integration of LLMs into FL introduces new challenges, particularly concerning the evaluation of LLMs.…

Artificial Intelligence · Computer Science 2024-04-19 Yuanqin He , Yan Kang , Lixin Fan , Qiang Yang

As large language models (LLMs) are trained on massive datasets, they have raised significant privacy and ethical concerns due to their potential to inadvertently retain sensitive information. Unlearning seeks to selectively remove specific…

Computation and Language · Computer Science 2025-06-17 Philipp Spohn , Leander Girrbach , Jessica Bader , Zeynep Akata

Federated Learning (FL) is a machine-learning approach enabling collaborative model training across multiple decentralized edge devices that hold local data samples, all without exchanging these samples. This collaborative process occurs…

Machine Learning · Computer Science 2024-01-02 Venkataraman Natarajan Iyer