English
Related papers

Related papers: Forget Less by Learning from Parents Through Hiera…

200 papers

Custom Diffusion Models (CDMs) have gained significant attention due to their remarkable ability to personalize generative processes. However, existing CDMs suffer from catastrophic forgetting when continuously learning new concepts. Most…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Arjun Ramesh Kaushik , Naresh Kumar Devulapally , Vishnu Suresh Lokhande , Nalini Ratha , Venu Govindaraju

Deep learning models are prone to forgetting information learned in the past when trained on new data. This problem becomes even more pronounced in the context of federated learning (FL), where data is decentralized and subject to…

Machine Learning · Computer Science 2023-07-19 Sara Babakniya , Zalan Fabian , Chaoyang He , Mahdi Soltanolkotabi , Salman Avestimehr

Federated learning (FL) has attracted growing attention via data-private collaborative training on decentralized clients. However, most existing methods unrealistically assume object classes of the overall framework are fixed over time. It…

Machine Learning · Computer Science 2022-03-23 Jiahua Dong , Lixu Wang , Zhen Fang , Gan Sun , Shichao Xu , Xiao Wang , Qi Zhu

Federated Continual Learning (FCL) has recently emerged as a crucial research area, as data from distributed clients typically arrives as a stream, requiring sequential learning. This paper explores a more practical and challenging FCL…

Machine Learning · Computer Science 2025-06-17 Minh-Duong Nguyen , Le-Tuan Nguyen , Quoc-Viet Pham

Deep learning models often suffer from forgetting previously learned information when trained on new data. This problem is exacerbated in federated learning (FL), where the data is distributed and can change independently for each user.…

Machine Learning · Computer Science 2023-11-22 Sara Babakniya , Zalan Fabian , Chaoyang He , Mahdi Soltanolkotabi , Salman Avestimehr

Custom diffusion models (CDMs) have attracted widespread attention due to their astonishing generative ability for personalized concepts. However, most existing CDMs unreasonably assume that personalized concepts are fixed and cannot change…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Jiahua Dong , Wenqi Liang , Hongliu Li , Duzhen Zhang , Meng Cao , Henghui Ding , Salman Khan , Fahad Shahbaz Khan

Federated learning is an important privacy-preserving multi-party learning paradigm, involving collaborative learning with others and local updating on private data. Model heterogeneity and catastrophic forgetting are two crucial…

Machine Learning · Computer Science 2023-09-29 Wenke Huang , Mang Ye , Zekun Shi , Bo Du

The paper demonstrate that simple adjustments of the fine-tuning recipes of multimodal large language models (MLLM) are sufficient to mitigate catastrophic forgetting. On visual question answering, we design a 2x2 experimental framework to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 He Li , Yuhui Zhang , Xiaohan Wang , Kaifeng Lyu , Serena Yeung-Levy

Federated Class Continual Learning (FCCL) merges the challenges of distributed client learning with the need for seamless adaptation to new classes without forgetting old ones. The key challenge in FCCL is catastrophic forgetting, an issue…

Machine Learning · Computer Science 2024-09-05 Jinglin Liang , Jin Zhong , Hanlin Gu , Zhongqi Lu , Xingxing Tang , Gang Dai , Shuangping Huang , Lixin Fan , Qiang Yang

Federated Learning (FL) allows collaborative machine learning training without sharing private data. Numerous studies have shown that one significant factor affecting the performance of federated learning models is the heterogeneity of data…

Machine Learning · Computer Science 2024-09-30 Liang Kuang , Kuangpu Guo , Jian Liang , Jianguo Zhang

Federated learning shows promise as a privacy-preserving collaborative learning technique. Existing heterogeneous federated learning mainly focuses on skewing the label distribution across clients. However, most approaches suffer from…

Machine Learning · Computer Science 2023-12-18 Shunxin Guo , Hongsong Wang , Xin Geng

In Federated Learning (FL), forgetting, or the loss of knowledge across rounds, hampers algorithm convergence, particularly in the presence of severe data heterogeneity among clients. This study explores the nuances of this issue,…

Machine Learning · Computer Science 2024-02-09 Mohammed Aljahdali , Ahmed M. Abdelmoniem , Marco Canini , Samuel Horváth

Federated learning (FL) is a hot collaborative training framework via aggregating model parameters of decentralized local clients. However, most FL methods unreasonably assume data categories of FL framework are known and fixed in advance.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Jiahua Dong , Hongliu Li , Yang Cong , Gan Sun , Yulun Zhang , Luc Van Gool

Continual learning (CL) aims to enable learning systems to acquire new knowledge constantly without forgetting previously learned information. CL faces the challenge of mitigating catastrophic forgetting while maintaining interpretability…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Lu Yu , Haoyu Han , Zhe Tao , Hantao Yao , Changsheng Xu

Federated learning is a distributed machine learning paradigm designed to protect data privacy. However, data heterogeneity across various clients results in catastrophic forgetting, where the model rapidly forgets previous knowledge while…

Machine Learning · Computer Science 2024-11-07 Pengju Wang , Bochao Liu , Weijia Guo , Yong Li , Shiming Ge

Federated learning-based semantic segmentation (FSS) has drawn widespread attention via decentralized training on local clients. However, most FSS models assume categories are fixed in advance, thus heavily undergoing forgetting on old…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Jiahua Dong , Duzhen Zhang , Yang Cong , Wei Cong , Henghui Ding , Dengxin Dai

Leveraging Large Language Models (LLMs) as federated learning (FL)-based time series foundation models offers a promising way to transfer the generalization capabilities of LLMs to time series data while preserving access to private data.…

Machine Learning · Computer Science 2026-04-07 Liwei Deng , Qingxiang Liu , Xinhe Niu , Shengchao Chen , Sheng Sun , Yuankai Wu , Guodong Long , Yuxuan Liang

Recent years have witnessed a burgeoning interest in federated learning (FL). However, the contexts in which clients engage in sequential learning remain under-explored. Bridging FL and continual learning (CL) gives rise to a challenging…

Machine Learning · Computer Science 2025-02-21 Abudukelimu Wuerkaixi , Sen Cui , Jingfeng Zhang , Kunda Yan , Bo Han , Gang Niu , Lei Fang , Changshui Zhang , Masashi Sugiyama

Recently, a large number of data sources opened up by informatization intensify the data heterogeneity, the faster speed of data generation and the gradual implementation of data regulations limit the storage time of data. In personalized…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-03 Sixing Tan , Xianmin Liu

Standard deep learning-based classification approaches may not always be practical in real-world clinical applications, as they require a centralized collection of all samples. Federated learning (FL) provides a paradigm that can learn from…

Machine Learning · Computer Science 2024-10-10 Atrin Arya , Sana Ayromlou , Armin Saadat , Purang Abolmaesumi , Xiaoxiao Li
‹ Prev 1 2 3 10 Next ›