中文
相关论文

相关论文: Understanding Imbalanced Forgetting in Rehearsal-B…

200 篇论文

Forgetting is often seen as an unwanted characteristic in both human and machine learning. However, we propose that forgetting can in fact be favorable to learning. We introduce "forget-and-relearn" as a powerful paradigm for shaping the…

机器学习 · 计算机科学 2022-02-02 Hattie Zhou , Ankit Vani , Hugo Larochelle , Aaron Courville

This paper studies the challenging continual learning (CL) setting of Class Incremental Learning (CIL). CIL learns a sequence of tasks consisting of disjoint sets of concepts or classes. At any time, a single model is built that can be…

机器学习 · 计算机科学 2023-06-23 Gyuhak Kim , Changnan Xiao , Tatsuya Konishi , Bing Liu

Meta-learning that uses implicit gradient have provided an exciting alternative to standard techniques which depend on the trajectory of the inner loop training. Implicit meta-learning (IML), however, require computing $2^{nd}$ order…

机器学习 · 计算机科学 2023-10-31 Fady Rezk

Deep neural networks perform remarkably well in close-world scenarios. However, novel classes emerged continually in real applications, making it necessary to learn incrementally. Class-incremental learning (CIL) aims to gradually recognize…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Wenzhuo Liu , Fei Zhu , Cheng-Lin Liu

Privacy concerns associated with machine learning models have driven research into machine unlearning, which aims to erase the memory of specific target training data from already trained models. This issue also arises in federated…

机器学习 · 计算机科学 2025-03-14 Yuyuan Li , Jiaming Zhang , Yixiu Liu , Chaochao Chen

Continual learning -- accumulating knowledge from a sequence of learning experiences -- is an important yet challenging problem. In this paradigm, the model's performance for previously encountered instances may substantially drop as…

机器学习 · 计算机科学 2022-07-14 Yasin Findik , Farhad Pourkamali-Anaraki

Class-incremental learning (CIL) seeks to enable a model to sequentially learn new classes while retaining knowledge of previously learned ones. Balancing flexibility and stability remains a significant challenge, particularly when the task…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Fangwen Wu , Lechao Cheng , Shengeng Tang , Xiaofeng Zhu , Chaowei Fang , Dingwen Zhang , Meng Wang

Class-incremental learning is a challenging problem, where the goal is to train a model that can classify data from an increasing number of classes over time. With the advancement of vision-language pre-trained models such as CLIP, they…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Linlan Huang , Xusheng Cao , Haori Lu , Xialei Liu

Multi-label class-incremental learning (MLCIL) is essential for real-world multi-label applications, allowing models to learn new labels while retaining previously learned knowledge continuously. However, recent MLCIL approaches can only…

计算机视觉与模式识别 · 计算机科学 2024-08-23 Kaile Du , Yifan Zhou , Fan Lyu , Yuyang Li , Junzhou Xie , Yixi Shen , Fuyuan Hu , Guangcan Liu

Real-world data streams naturally include the repetition of previous concepts. From a Continual Learning (CL) perspective, repetition is a property of the environment and, unlike replay, cannot be controlled by the agent. Nowadays, the…

While numerous machine unlearning (MU) methods have recently been developed with promising results in erasing the influence of forgotten data, classes, or concepts, they are also highly vulnerable-for example, simple fine-tuning can…

机器学习 · 计算机科学 2026-04-10 Yichen Gao , Altay Unal , Akshay Rangamani , Zhihui Zhu

Online class imbalance learning deals with data streams that are affected by both concept drift and class imbalance. Online learning tries to find a trade-off between exploiting previously learned information and incorporating new…

机器学习 · 计算机科学 2021-03-29 Amir Abolfazli , Eirini Ntoutsi

Continual learning for Semantic Segmentation (CSS) is a rapidly emerging field, in which the capabilities of the segmentation model are incrementally improved by learning new classes or new domains. A central challenge in Continual Learning…

计算机视觉与模式识别 · 计算机科学 2022-09-21 Tobias Kalb , Björn Mauthe , Jürgen Beyerer

Continual learning (CL) is a major challenge of machine learning (ML) and describes the ability to learn several tasks sequentially without catastrophic forgetting (CF). Recent works indicate that CL is a complex topic, even more so when…

机器学习 · 计算机科学 2022-06-09 Benedikt Bagus , Alexander Gepperth

Incremental Learning (IL) allows AI systems to adapt to streamed data. Most existing algorithms make two strong hypotheses which reduce the realism of the incremental scenario: (1) new data are assumed to be readily annotated when streamed…

计算机视觉与模式识别 · 计算机科学 2020-08-26 Eden Belouadah , Adrian Popescu , Umang Aggarwal , Léo Saci

Class-level machine unlearning aims to remove the influence of specified classes while preserving model utility on retained classes. Existing methods are commonly evaluated by retain-set accuracy, forget-set accuracy, and unlearning time,…

机器学习 · 计算机科学 2026-05-12 Weidong Zheng , Kongyang Chen , Yuanwei Guo , Yatie Xiao

Low-Earth-orbit (LEO) satellite constellations are increasingly performing on-board computing. However, the continuous emergence of new classes under strict memory and communication constraints poses major challenges for collaborative…

网络与互联网体系结构 · 计算机科学 2026-04-06 Heng Zhang , Xiaohong Deng , Sijing Duan , Wu Ouyang , KM Mahfujul , Yiqin Deng , Zhigang Chen

Class-incremental learning (CIL) for time series data faces critical challenges in balancing stability against catastrophic forgetting and plasticity for new knowledge acquisition, particularly under real-world constraints where historical…

机器学习 · 计算机科学 2025-03-11 Yuanlong Wu , Mingxing Nie , Tao Zhu , Liming Chen , Huansheng Ning , Yaping Wan

While many works on Continual Learning have shown promising results for mitigating catastrophic forgetting, they have relied on supervised training. To successfully learn in a label-agnostic incremental setting, a model must distinguish…

机器学习 · 计算机科学 2021-12-09 Shivam Khare , Kun Cao , James Rehg

Model learning from class imbalanced training data is a long-standing and significant challenge for machine learning. In particular, existing deep learning methods consider mostly either class balanced data or moderately imbalanced data in…

计算机视觉与模式识别 · 计算机科学 2018-05-01 Qi Dong , Shaogang Gong , Xiatian Zhu