English
Related papers

Related papers: A distillation-based approach integrating continua…

200 papers

Federated Learning (FL) is a machine learning technique that enables multiple entities to collaboratively learn a shared model without exchanging their local data. Over the past decade, FL systems have achieved substantial progress, scaling…

Machine Learning · Computer Science 2025-03-04 Katharine Daly , Hubert Eichner , Peter Kairouz , H. Brendan McMahan , Daniel Ramage , Zheng Xu

Unsupervised Continual Learning (UCL) is a burgeoning field in machine learning, focusing on enabling neural networks to sequentially learn tasks without explicit label information. Catastrophic Forgetting (CF), where models forget…

Machine Learning · Computer Science 2024-05-30 Mohammadreza Sadeghi , Zihan Wang , Narges Armanfard

Federated Learning (FL) is a distributed machine learning paradigm which coordinates multiple clients to collaboratively train a global model via a central server. Sequential Federated Learning (SFL) is a newly-emerging FL training…

Machine Learning · Computer Science 2025-07-14 Haotian Xu , Jinrui Zhou , Xichong Zhang , Mingjun Xiao , He Sun , Yin Xu

We propose a novel federated learning method for distributively training neural network models, where the server orchestrates cooperation between a subset of randomly chosen devices in each round. We view Federated Learning problem…

Federated learning (FL) enables a decentralized machine learning paradigm for multiple clients to collaboratively train a generalized global model without sharing their private data. Most existing works simply propose typical FL systems for…

Machine Learning · Computer Science 2023-11-08 Huy Q. Le , Minh N. H. Nguyen , Chu Myaet Thwal , Yu Qiao , Chaoning Zhang , Choong Seon Hong

Federated learning has been extensively studied and is the prevalent method for privacy-preserving distributed learning in edge devices. Correspondingly, continual learning is an emerging field targeted towards learning multiple tasks…

Machine Learning · Computer Science 2022-03-28 Yeshwanth Venkatesha , Youngeun Kim , Hyoungseob Park , Yuhang Li , Priyadarshini Panda

Class-incremental learning aims to learn new classes in an incremental fashion without forgetting the previously learned ones. Several research works have shown how additional data can be used by incremental models to help mitigate…

Machine Learning · Computer Science 2023-10-11 Quentin Jodelet , Xin Liu , Yin Jun Phua , Tsuyoshi Murata

We introduce GUIDE, a novel continual learning approach that directs diffusion models to rehearse samples at risk of being forgotten. Existing generative strategies combat catastrophic forgetting by randomly sampling rehearsal examples from…

Machine Learning · Computer Science 2024-06-03 Bartosz Cywiński , Kamil Deja , Tomasz Trzciński , Bartłomiej Twardowski , Łukasz Kuciński

Lifelong learning with deep neural networks is well-known to suffer from catastrophic forgetting: the performance on previous tasks drastically degrades when learning a new task. To alleviate this effect, we propose to leverage a large…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Kibok Lee , Kimin Lee , Jinwoo Shin , Honglak Lee

Federated learning (FL) is an effective solution to train machine learning models on the increasing amount of data generated by IoT devices and smartphones while keeping such data localized. Most previous work on federated learning assumes…

Machine Learning · Computer Science 2023-01-05 Othmane Marfoq , Giovanni Neglia , Laetitia Kameni , Richard Vidal

One-shot Federated learning (FL) is a powerful technology facilitating collaborative training of machine learning models in a single round of communication. While its superiority lies in communication efficiency and privacy preservation…

Machine Learning · Computer Science 2024-12-09 Junyuan Zhang , Songhua Liu , Xinchao Wang

Multimodal Deep Learning has garnered much interest, and transformers have triggered novel approaches, thanks to the cross-attention mechanism. Here we propose an approach to deal with two key existing challenges: the high computational…

Machine Learning · Computer Science 2021-10-20 Dhruv Agarwal , Tanay Agrawal , Laura M. Ferrari , François Bremond

As a promising distributed machine learning paradigm, Federated Learning (FL) trains a central model with decentralized data without compromising user privacy, which has made it widely used by Artificial Intelligence Internet of Things…

Machine Learning · Computer Science 2022-05-13 Tian Liu , Zhiwei Ling , Jun Xia , Xin Fu , Shui Yu , Mingsong Chen

Modern machine learning systems need to be able to cope with constantly arriving and changing data. Two main areas of research dealing with such scenarios are continual learning and data stream mining. Continual learning focuses on…

Machine Learning · Computer Science 2021-04-27 Łukasz Korycki , Bartosz Krawczyk

Federated learning is the process of developing machine learning models over datasets distributed across data centers such as hospitals, clinical research labs, and mobile devices while preventing data leakage. This survey examines previous…

Machine Learning · Computer Science 2022-11-22 Madhura Joshi , Ankit Pal , Malaikannan Sankarasubbu

The rise of cloud-device collaborative computing has enabled intelligent services to be delivered across distributed edge devices while leveraging centralized cloud resources. In this paradigm, federated learning (FL) has become a key…

Machine Learning · Computer Science 2025-12-22 Xiao Zhang , Zengzhe Chen , Yuan Yuan , Yifei Zou , Fuzhen Zhuang , Wenyu Jiao , Yuke Wang , Dongxiao Yu

Federated learning has attracted increasing attention to building models without accessing the raw user data, especially in healthcare. In real applications, different federations can seldom work together due to possible reasons such as…

Machine Learning · Computer Science 2023-07-11 Yiqiang Chen , Wang Lu , Xin Qin , Jindong Wang , Xing Xie

A common scenario of Multilingual Neural Machine Translation (MNMT) is that each translation task arrives in a sequential manner, and the training data of previous tasks is unavailable. In this scenario, the current methods suffer heavily…

Computation and Language · Computer Science 2022-12-07 Yang Zhao , Junnan Zhu , Lu Xiang , Jiajun Zhang , Yu Zhou , Feifei Zhai , Chengqing Zong

Federated learning (FL) is a promising approach for enhancing data privacy preservation, particularly for authentication systems. However, limited round communications, scarce representation, and scalability pose significant challenges to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Hansol Kim , Youngjun Kwak , Minyoung Jung , Jinho Shin , Youngsung Kim , Changick Kim

Collaboration between healthcare institutions can significantly lessen the imbalance in medical resources across various geographic areas. However, directly sharing diagnostic information between institutions is typically not permitted due…

Machine Learning · Computer Science 2023-02-14 Chung-ju Huang , Leye Wang , Xiao Han