English
Related papers

Related papers: Continual Learning Based on OOD Detection and Task…

200 papers

Despite the recent progress in incremental learning, addressing catastrophic forgetting under distributional drift is still an open and important problem. Indeed, while state-of-the-art domain incremental learning (DIL) methods perform…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Julien Nicolas , Florent Chiaroni , Imtiaz Ziko , Ola Ahmad , Christian Desrosiers , Jose Dolz

Continual learning allows a model to learn multiple tasks sequentially while retaining the old knowledge without the training data of the preceding tasks. This paper extends the scope of continual learning research to class-incremental…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Zhizheng Liu , Mattia Segu , Fisher Yu

Out-of-distribution (OOD) detection is essential for reliable and trustworthy machine learning. Recent multi-modal OOD detection leverages textual information from in-distribution (ID) class names for visual OOD detection, yet it currently…

Computation and Language · Computer Science 2023-10-13 Yi Dai , Hao Lang , Kaisheng Zeng , Fei Huang , Yongbin Li

This paper studies continual learning (CL) of a sequence of aspect sentiment classification(ASC) tasks in a particular CL setting called domain incremental learning (DIL). Each task is from a different domain or product. The DIL setting is…

Computation and Language · Computer Science 2021-12-21 Zixuan Ke , Bing Liu , Hu Xu , Lei Shu

We observe a high level of imbalance in the accuracy of different classes in the same old task for the first time. This intriguing phenomenon, discovered in replay-based Class Incremental Learning (CIL), highlights the imbalanced forgetting…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Shixiong Xu , Gaofeng Meng , Xing Nie , Bolin Ni , Bin Fan , Shiming Xiang

Class incremental learning (CIL) aims to recognize both the old and new classes along the increment tasks. Deep neural networks in CIL suffer from catastrophic forgetting and some approaches rely on saving exemplars from previous tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Xiuwei Chen , Xiaobin Chang

Despite recent progress in enhancing the efficacy of Open-Domain Continual Learning (ODCL) in Vision-Language Models (VLM), failing to (1) correctly identify the Task-ID of a test image and (2) use only the category set corresponding to the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Yadong Lu , Shitian Zhao , Boxiang Yun , Dongsheng Jiang , Yin Li , Qingli Li , Yan Wang

Out-of-distribution (OOD) detection is crucial for deploying robust machine learning models, especially in areas where security is critical. However, traditional OOD detection methods often fail to capture complex data distributions from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Armando Zhu , Jiabei Liu , Keqin Li , Shuying Dai , Bo Hong , Peng Zhao , Changsong Wei

A significant challenge in achieving ubiquitous Artificial Intelligence is the limited ability of models to rapidly learn new information in real-world scenarios where data follows long-tailed distributions, all while avoiding forgetting…

Machine Learning · Computer Science 2024-04-09 Siddeshwar Raghavan , Jiangpeng He , Fengqing Zhu

The open-world assumption in model development suggests that a model might lack sufficient information to adequately handle data that is entirely distinct or out of distribution (OOD). While deep learning methods have shown promising…

Machine Learning · Computer Science 2025-05-21 Achmad Ginanjar , Xue Li , Priyanka Singh , Wen Hua

Detecting out-of-distribution (OOD) data is crucial in real-world machine learning applications, particularly in safety-critical domains. Existing methods often leverage language information from vision-language models (VLMs) to enhance OOD…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Shu Zou , Xinyu Tian , Qinyu Zhao , Zhaoyuan Yang , Jing Zhang

Class-Incremental Learning (CIL) is a critical capability for real-world applications, enabling learning systems to adapt to new tasks while retaining knowledge from previous ones. Recent advancements in pre-trained models (PTMs) have…

Machine Learning · Computer Science 2025-04-28 Kun He , Zijian Song , Shuoxi Zhang , John E. Hopcroft

Learning from non-stationary data streams, also called Task-Free Continual Learning (TFCL) remains challenging due to the absence of explicit task information. Although recently some methods have been proposed for TFCL, they lack…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Fei Ye , Adrian G. Bors

New categories may be introduced over time, or existing categories may need to be reclassified. Class incremental learning (CIL) is employed for the gradual acquisition of knowledge about new categories while preserving information about…

Machine Learning · Computer Science 2024-01-08 Zhiwei Zuo , Zhuo Tang , Bin Wang , Kenli Li , Anwitaman Datta

Active learning aims to improve the performance of task model by selecting the most informative samples with a limited budget. Unlike most recent works that focused on applying active learning for image classification, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Weiping Yu , Sijie Zhu , Taojiannan Yang , Chen Chen

This work explores class-incremental learning (CIL) for sound event detection (SED), advancing adaptability towards real-world scenarios. CIL's success in domains like computer vision inspired our SED-tailored method, addressing the unique…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Yang Xiao , Rohan Kumar Das

Continual learning requires learning incremental tasks with dynamic data distributions. So far, it has been observed that employing a combination of contrastive loss and distillation loss for training in continual learning yields strong…

Machine Learning · Computer Science 2024-05-30 Yichen Wen , Zhiquan Tan , Kaipeng Zheng , Chuanlong Xie , Weiran Huang

The ability to detect OOD data is a crucial aspect of practical machine learning applications. In this work, we show that cosine similarity between the test feature and the typical ID feature is a good indicator of OOD data. We propose…

Machine Learning · Computer Science 2023-06-28 Nguyen Ngoc-Hieu , Nguyen Hung-Quang , The-Anh Ta , Thanh Nguyen-Tang , Khoa D Doan , Hoang Thanh-Tung

Recent advancements in video large multimodal models (LMMs) have significantly improved their video understanding and reasoning capabilities. However, their performance drops on out-of-distribution (OOD) tasks that are underrepresented in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Kangsan Kim , Geon Park , Youngwan Lee , Woongyeong Yeo , Sung Ju Hwang

Class incremental learning (CIL) aims to enable models to continuously learn new classes without catastrophically forgetting old ones. A promising direction is to learn and use prototypes of classes during incremental updates. Despite…

Machine Learning · Computer Science 2025-03-25 Huitong Chen , Yu Wang , Yan Fan , Guosong Jiang , Qinghua Hu