English
Related papers

Related papers: Large-Small Model Collaborative Framework for Fede…

200 papers

Catastrophic forgetting (CF) poses a significant challenge in machine learning, where a model forgets previously learned information upon learning new tasks. Despite the advanced capabilities of Large Language Models (LLMs), they continue…

Machine Learning · Computer Science 2025-04-17 Gangwei Jiang , Caigao Jiang , Zhaoyi Li , Siqiao Xue , Jun Zhou , Linqi Song , Defu Lian , Ying Wei

Today data is often scattered among billions of resource-constrained edge devices with security and privacy constraints. Federated Learning (FL) has emerged as a viable solution to learn a global model while keeping data private, but the…

Machine Learning · Computer Science 2021-12-08 Sijie Cheng , Jingwen Wu , Yanghua Xiao , Yang Liu , Yang Liu

As social robots become increasingly integrated into daily life, ensuring their behaviours align with social norms is crucial. For their widespread open-world application, it is important to explore Federated Learning (FL) settings where…

Machine Learning · Computer Science 2024-03-13 Saksham Checker , Nikhil Churamani , Hatice Gunes

Federated Learning (FL) is a decentralized collaborative Machine Learning framework for training models without collecting data in a centralized location. It has seen application across various disciplines, from helping medical diagnoses in…

Machine Learning · Computer Science 2025-06-26 Arno Geimer , Karthick Panner Selvam , Beltran Fiz Pontiveros

Federated learning (FL) is an appealing paradigm that allows a group of machines (a.k.a. clients) to learn collectively while keeping their data local. However, due to the heterogeneity between the clients' data distributions, the model…

Machine Learning · Computer Science 2024-10-01 Youssef Allouah , Abdellah El Mrini , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot

Modern big-data systems generate massive, heterogeneous, and geographically dispersed streams that are large-scale and privacy-sensitive, making centralization challenging. While federated learning (FL) provides a privacy-enhancing training…

Machine Learning · Computer Science 2026-02-20 Obaidullah Zaland , Zulfiqar Ahmad Khan , Monowar Bhuyan

The intersection of Foundation Model (FM) and Federated Learning (FL) presents a unique opportunity to unlock new possibilities for real-world applications. On the one hand, FL, as a collaborative learning paradigm, help address challenges…

Machine Learning · Computer Science 2025-05-06 Weiming Zhuang , Chen Chen , Jingtao Li , Chaochao Chen , Yaochu Jin , Lingjuan Lyu

Online Continual Learning (CL) solves the problem of learning the ever-emerging new classification tasks from a continuous data stream. Unlike its offline counterpart, in online CL, the training data can only be seen once. Most existing…

Machine Learning · Computer Science 2024-04-02 Maorong Wang , Nicolas Michel , Ling Xiao , Toshihiko Yamasaki

Conventional federated learning (FL) frameworks follow a server-driven model where the server determines session initiation and client participation, which faces challenges in accommodating clients' asynchronous needs for model updates. We…

Machine Learning · Computer Science 2024-05-27 Songze Li , Chenqing Zhu

Over the past several years, various federated learning (FL) methodologies have been developed to improve model accuracy, a primary performance metric in machine learning. However, to utilize FL in practical decision-making scenarios,…

Machine Learning · Computer Science 2025-01-24 Yun-Wei Chu , Dong-Jun Han , Seyyedali Hosseinalipour , Christopher Brinton

By adapting Large Language Models (LLMs) to domain-specific tasks or enriching them with domain-specific knowledge, we can fully harness the capabilities of LLMs. Nonetheless, a gap persists in achieving simultaneous mutual enhancement…

Computation and Language · Computer Science 2026-04-24 Tao Fan , Yan Kang , Guoqiang Ma , Lixin Fan , Shuoling Liu , Kai Chen , Qiang Yang

LLMs have demonstrated great capabilities in various NLP tasks. Different entities can further improve the performance of those LLMs on their specific downstream tasks by fine-tuning LLMs. When several entities have similar interested…

Machine Learning · Computer Science 2023-09-04 Weirui Kuang , Bingchen Qian , Zitao Li , Daoyuan Chen , Dawei Gao , Xuchen Pan , Yuexiang Xie , Yaliang Li , Bolin Ding , Jingren Zhou

In the realm of real-world devices, centralized servers in Federated Learning (FL) present challenges including communication bottlenecks and susceptibility to a single point of failure. Additionally, contemporary devices inherently exhibit…

Machine Learning · Computer Science 2024-08-15 Yasser H. Khalil , Amir H. Estiri , Mahdi Beitollahi , Nader Asadi , Sobhan Hemati , Xu Li , Guojun Zhang , Xi Chen

Federated Learning has been introduced as a new machine learning paradigm enhancing the use of local devices. At a server level, FL regularly aggregates models learned locally on distributed clients to obtain a more general model. In this…

Machine Learning · Computer Science 2022-07-19 Anastasiia Usmanova , François Portet , Philippe Lalanda , German Vega

Federated Class-Incremental Learning (FCIL) refers to a scenario where a dynamically changing number of clients collaboratively learn an ever-increasing number of incoming tasks. FCIL is known to suffer from local forgetting due to class…

Machine Learning · Computer Science 2025-03-17 Milad Khademi Nori , Il-Min Kim , Guanghui Wang

Federated Learning (FL) is a machine learning paradigm where many local nodes collaboratively train a central model while keeping the training data decentralized. This is particularly relevant for clinical applications since patient data…

Few-shot continual learning (FSCL) has attracted intensive attention and achieved some advances in recent years, but now it is difficult to again make a big stride in accuracy due to the limitation of only few-shot incremental samples.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Ziqi Gu , Chunyan Xu , Zihan Lu , Xin Liu , Anbo Dai , Zhen Cui

Machine learning (ML) has recently been adopted in vehicular networks for applications such as autonomous driving, road safety prediction and vehicular object detection, due to its model-free characteristic, allowing adaptive fast response.…

Signal Processing · Electrical Eng. & Systems 2022-07-19 Ahmet M. Elbir , Burak Soner , Sinem Coleri , Deniz Gunduz , Mehdi Bennis

Federated learning (FL) ameliorates privacy concerns in settings where a central server coordinates learning from data distributed across many clients. The clients train locally and communicate the models they learn to the server;…

Machine Learning · Computer Science 2020-10-16 Monica Ribero , Haris Vikalo

Federated Learning (FL) and Split Learning (SL) are privacy-preserving Machine-Learning (ML) techniques that enable training ML models over data distributed among clients without requiring direct access to their raw data. Existing FL and SL…

Machine Learning · Computer Science 2022-11-08 Ali Abedi , Shehroz S. Khan