English
Related papers

Related papers: Collaborative Learning of On-Device Small Model an…

200 papers

Privacy protection is an ethical issue with broad concern in Artificial Intelligence (AI). Federated learning is a new machine learning paradigm to learn a shared model across users or organisations without direct access to the data. It has…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-25 Guodong Long , Tao Shen , Yue Tan , Leah Gerrard , Allison Clarke , Jing Jiang

Federated learning (FL) has been developed as a promising framework to leverage the resources of edge devices, enhance customers' privacy, comply with regulations, and reduce development costs. Although many methods and applications have…

Machine Learning · Computer Science 2022-02-03 Jie Ding , Eric Tramel , Anit Kumar Sahu , Shuang Wu , Salman Avestimehr , Tao Zhang

Federated learning (FL) is a distributed training paradigm that enables collaborative learning across clients without sharing local data, thereby preserving privacy. However, the increasing scale and complexity of modern deep models often…

Machine Learning · Computer Science 2025-05-20 Honggu Kang , Seohyeon Cha , Joonhyuk Kang

In this paper, we investigate collaborative active learning, a paradigm in which multiple collaborators explore a new domain by leveraging their combined machine learning capabilities without disclosing their existing data and models.…

Machine Learning · Computer Science 2024-03-28 Zan-Kai Chong , Hiroyuki Ohsaki , Bryan Ng

In the field of heterogeneous federated learning (FL), the key challenge is to efficiently and collaboratively train models across multiple clients with different data distributions, model structures, task objectives, computational…

Machine Learning · Computer Science 2025-03-11 Chuan Chen , Tianchi Liao , Xiaojun Deng , Zihou Wu , Sheng Huang , Zibin Zheng

Federated learning (FL) refers to a distributed machine learning framework involving learning from several decentralized edge clients without sharing local dataset. This distributed strategy prevents data leakage and enables on-device…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-28 Taki Hasan Rafi , Faiza Anan Noor , Tahmid Hussain , Dong-Kyu Chae , Zhaohui Yang

Federated Learning (FL) has emerged as a promising technique for edge devices to collaboratively learn a shared prediction model, while keeping their training data on the device, thereby decoupling the ability to do machine learning from…

The advent of large language models (LLMs) revolutionized natural language processing applications, and running LLMs on edge devices has become increasingly attractive for reasons including reduced latency, data localization, and…

Computation and Language · Computer Science 2024-09-17 Jiajun Xu , Zhiyuan Li , Wei Chen , Qun Wang , Xin Gao , Qi Cai , Ziyuan Ling

Motivated by the explosive computing capabilities at end user equipments, as well as the growing privacy concerns over sharing sensitive raw data, a new machine learning paradigm, named federated learning (FL) has emerged. By training…

Networking and Internet Architecture · Computer Science 2021-06-07 Chuan Ma , Jun Li , Ming Ding , Long Shi , Taotao Wang , Zhu Han , H. Vincent Poor

Open-set object recognition aims to identify if an object is from a class that has been encountered during training or not. To perform open-set object recognition accurately, a key challenge is how to reduce the reliance on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Haoxuan Qu , Xiaofei Hui , Yujun Cai , Jun Liu

We study (differentially) private federated learning (FL) of language models. The language models in cross-device FL are relatively small, which can be trained with meaningful formal user-level differential privacy (DP) guarantees when…

Machine Learning · Computer Science 2024-04-16 Boxin Wang , Yibo Jacky Zhang , Yuan Cao , Bo Li , H. Brendan McMahan , Sewoong Oh , Zheng Xu , Manzil Zaheer

Federated learning (FL) has been promoted as a popular technique for training machine learning (ML) models over edge/fog networks. Traditional implementations of FL have largely neglected the potential for inter-network cooperation,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-16 Su Wang , Seyyedali Hosseinalipour , Vaneet Aggarwal , Christopher G. Brinton , David J. Love , Weifeng Su , Mung Chiang

With privacy as a motivation, Federated Learning (FL) is an increasingly used paradigm where learning takes place collectively on edge devices, each with a cache of user-generated training examples that remain resident on the local device.…

Machine Learning · Computer Science 2021-11-25 Sean Augenstein , Andrew Hard , Kurt Partridge , Rajiv Mathews

Federated Continual Learning (FCL) has emerged as a robust solution for collaborative model training in dynamic environments, where data samples are continuously generated and distributed across multiple devices. This survey provides a…

Machine Learning · Computer Science 2025-07-17 Parisa Hamedi , Roozbeh Razavi-Far , Ehsan Hallaji

This book offers a hands-on introduction to building and understanding federated learning (FL) systems. FL enables multiple devices -- such as smartphones, sensors, or local computers -- to collaboratively train machine learning (ML)…

Machine Learning · Computer Science 2025-06-11 A. Jung

Federated learning was proposed with an intriguing vision of achieving collaborative machine learning among numerous clients without uploading their private data to a cloud server. However, the conventional framework requires each client to…

Machine Learning · Computer Science 2019-11-12 Chaoyue Niu , Fan Wu , Shaojie Tang , Lifeng Hua , Rongfei Jia , Chengfei Lv , Zhihua Wu , Guihai Chen

Machine learning algorithms are undoubtedly one of the most popular algorithms in recent years, and neural networks have demonstrated unprecedented precision. In daily life, different communities may have different user characteristics,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-24 Yang ChaoQun

Recent research has explored using Large Language Models for recommendation tasks by transforming user interaction histories and item metadata into text prompts, then having the LLM produce rankings or recommendations. A promising approach…

Information Retrieval · Computer Science 2025-10-03 Bo Ma , LuYao Liu , Simon Lau , Chandler Yuan , and XueY Cui , Rosie Zhang

In this paper, we investigate the intersection of large generative AI models and cloud-native computing architectures. Recent large models such as ChatGPT, while revolutionary in their capabilities, face challenges like escalating costs and…

Influenced by the great success of deep learning via cloud computing and the rapid development of edge chips, research in artificial intelligence (AI) has shifted to both of the computing paradigms, i.e., cloud computing and edge computing.…