中文
相关论文

相关论文: Benchmarking Catastrophic Forgetting Mitigation Me…

200 篇论文

In this paper, we propose a new method to overcome catastrophic forgetting by adding generative regularization to Bayesian inference framework. Bayesian method provides a general framework for continual learning. We could further construct…

机器学习 · 计算机科学 2021-06-22 Patrick H. Chen , Wei Wei , Cho-jui Hsieh , Bo Dai

Federated Learning (FL) has emerged as a transformative approach for distributed machine learning, particularly in edge computing environments where data privacy, low latency, and bandwidth efficiency are critical. This paper presents a…

分布式、并行与集群计算 · 计算机科学 2026-03-11 Sales Aribe , Gil Nicholas Cagande

Federated learning (FL) has broadened the horizon for multivariate time series anomaly detection (MTSAD). However, benchmarking such anomaly detection methods within FL paradigm poses data-centric challenges. The existing datasets do not…

机器学习 · 计算机科学 2026-05-28 Khayyam Nosrati , Martin Uray , Saverio Messineo , Olaf Sassnick , Stefan Huber

Federated continual learning (FCL) allows each client to continually update its knowledge from task streams, enhancing the applicability of federated learning in real-world scenarios. However, FCL needs to address not only spatial data…

计算机视觉与模式识别 · 计算机科学 2025-03-06 Hao Yu , Xin Yang , Le Zhang , Hanlin Gu , Tianrui Li , Lixin Fan , Qiang Yang

Artificial neural networks encounter a notable challenge known as continual learning, which involves acquiring knowledge of multiple tasks over an extended period. This challenge arises due to the tendency of previously learned weights to…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Yonatan Sverdlov , Shimon Ullman

Meta-forecasting is a newly emerging field which combines meta-learning and time series forecasting. The goal of meta-forecasting is to train over a collection of source time series and generalize to new time series one-at-a-time. Previous…

机器学习 · 计算机科学 2023-02-07 Mike Van Ness , Huibin Shen , Hao Wang , Xiaoyong Jin , Danielle C. Maddix , Karthick Gopalswamy

In real-world applications, learning-enabled systems often undergo iterative model development to address challenging or emerging tasks, which involve collecting new data, training a new model and validating the model. This continual model…

机器学习 · 计算机科学 2025-04-22 Gang Li , Wendi Yu , Yao Yao , Wei Tong , Yingbin Liang , Qihang Lin , Tianbao Yang

Continual learning (CL) refers to a machine learning paradigm that learns continuously without forgetting previously acquired knowledge. Thereby, major difficulty in CL is catastrophic forgetting of preceding tasks, caused by shifts in data…

机器学习 · 计算机科学 2023-03-08 Stella Ho , Ming Liu , Lan Du , Longxiang Gao , Yong Xiang

Federated Learning (FL) methods adopt efficient communication technologies to distribute machine learning tasks across edge devices, reducing the overhead in terms of data storage and computational complexity compared to centralized…

信号处理 · 电气工程与系统科学 2024-05-27 Luca Barbieri , Stefano Savazzi , Sanaz Kianoush , Monica Nicoli , Luigi Serio

Neural language models deployed in real-world applications must continually adapt to new tasks and domains without forgetting previously acquired knowledge. This work presents a comparative empirical study of catastrophic forgetting…

计算与语言 · 计算机科学 2026-03-20 Aram Abrahamyan , Sachin Kumar

As a prevalent distributed learning paradigm, Federated Learning (FL) trains a global model on a massive amount of devices with infrequent communication. This paper investigates a class of composite optimization and statistical recovery…

机器学习 · 计算机科学 2022-10-04 Yajie Bao , Michael Crawshaw , Shan Luo , Mingrui Liu

Continual learning (CL) aims to constantly learn new knowledge over time while avoiding catastrophic forgetting on old tasks. We focus on continual text classification under the class-incremental setting. Recent CL studies have identified…

计算与语言 · 计算机科学 2023-10-11 Yifan Song , Peiyi Wang , Weimin Xiong , Dawei Zhu , Tianyu Liu , Zhifang Sui , Sujian Li

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

计算与语言 · 计算机科学 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

Federated Class-Incremental Learning (FCIL) increasingly becomes important in the decentralized setting, where it enables multiple participants to collaboratively train a global model to perform well on a sequence of tasks without sharing…

机器学习 · 计算机科学 2024-07-17 Thinh Nguyen , Khoa D Doan , Binh T. Nguyen , Danh Le-Phuoc , Kok-Seng Wong

Clustered federated learning (CFL) addresses the performance challenges posed by data heterogeneity in federated learning (FL) by organizing edge devices with similar data distributions into clusters, enabling collaborative model training…

机器学习 · 计算机科学 2025-01-06 Yuxin Zhang , Haoyu Chen , Zheng Lin , Zhe Chen , Jin Zhao

Continual learning (CL) enables animals to learn new tasks without erasing prior knowledge. CL in artificial neural networks (NNs) is challenging due to catastrophic forgetting, where new learning degrades performance on older tasks. While…

机器学习 · 计算机科学 2025-01-28 Haozhe Shan , Qianyi Li , Haim Sompolinsky

Long-term time series forecasting (LTSF) is widely recognized as a central challenge in data mining and machine learning. LTSF has increasingly evolved into a benchmark-driven ''GAME,'' where models are ranked, compared, and declared…

机器学习 · 计算机科学 2026-03-10 Thanapol Phungtua-eng , Yoshitaka Yamamoto

Autonomous machine learning systems that learn many tasks in sequence are prone to the catastrophic forgetting problem. Mathematical theory is needed in order to understand the extent of forgetting during continual learning. As a…

机器学习 · 计算机科学 2025-02-18 Daniel Goldfarb , Paul Hand

Neural networks have achieved remarkable success in many cognitive tasks. However, when they are trained sequentially on multiple tasks without access to old data, their performance on early tasks tend to drop significantly. This problem is…

机器学习 · 计算机科学 2021-02-10 Dong Yin , Mehrdad Farajtabar , Ang Li , Nir Levine , Alex Mott

Training a general-purpose time series foundation models with robust generalization capabilities across diverse applications from scratch is still an open challenge. Efforts are primarily focused on fusing cross-domain time series datasets…

机器学习 · 计算机科学 2024-12-13 Shengchao Chen , Guodong Long , Jing Jiang , Chengqi Zhang