English
Related papers

Related papers: Exploring the Tradeoff Between Diversity and Discr…

200 papers

Class-incremental learning (CIL) enables models to continuously learn new categories from sequential tasks without forgetting previously acquired knowledge. While recent advances in vision-language models such as CLIP have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Haoran Chen , Houze Xu , Micah Goldblum , Daoguo Dong , Zuxuan Wu

Class Incremental Learning (CIL) aims to enable models to learn new classes sequentially while retaining knowledge of previous ones. Although current methods have alleviated catastrophic forgetting (CF), recent studies highlight that the…

Machine Learning · Computer Science 2025-03-19 Guannan Lai , Yujie Li , Xiangkun Wang , Junbo Zhang , Tianrui Li , Xin Yang

We introduce Test-Time Discovery (TTD) as a novel task that addresses class shifts during testing, requiring models to simultaneously identify emerging categories while preserving previously learned ones. A key challenge in TTD is…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Fan Lyu , Tianle Liu , Zhang Zhang , Fuyuan Hu , Liang Wang

Generalized Category Discovery (GCD) requires a model to both classify known categories and cluster unknown categories in unlabeled data. Prior methods leveraged self-supervised pre-training combined with supervised fine-tuning on the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Rabah Ouldnoughi , Chia-Wen Kuo , Zsolt Kira

Out-of-distribution detection (OOD) is a pivotal task for real-world applications that trains models to identify samples that are distributionally different from the in-distribution (ID) data during testing. Recent advances in AI,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Chaohua Li , Enhao Zhang , Chuanxing Geng , Songcan Chen

Multi-Label Online Continual Learning (MOCL) requires models to learn continuously from endless multi-label data streams, facing complex challenges including persistent catastrophic forgetting, potential missing labels, and uncontrollable…

Machine Learning · Computer Science 2025-05-27 Xinrui Wang , Shao-yuan Li , Jiaqiang Zhang , Songcan Chen

We consider the problem of learning multiple tasks in a continual learning setting in which data from different tasks is presented to the learner in a streaming fashion. A key challenge in this setting is the so-called "catastrophic…

Machine Learning · Computer Science 2023-09-22 Christiaan Lamers , Rene Vidal , Nabil Belbachir , Niki van Stein , Thomas Baeck , Paris Giampouras

Detecting abrupt changes in data distribution is one of the most significant tasks in streaming data analysis. Although many unsupervised Change-Point Detection (CPD) methods have been proposed recently to identify those changes, they still…

Machine Learning · Computer Science 2024-04-26 Yang Cao , Ye Zhu , Kai Ming Ting , Flora D. Salim , Hong Xian Li , Luxing Yang , Gang Li

Incremental object detection (IOD) aims to sequentially learn new classes, while maintaining the capability to locate and identify old ones. As the training data arrives with annotations only with new classes, IOD suffers from catastrophic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Jichuan Zhang , Wei Li , Shuang Cheng , Ya-Li Li , Shengjin Wang

Continual learning allows a model to learn multiple tasks sequentially while retaining the old knowledge without the training data of the preceding tasks. This paper extends the scope of continual learning research to class-incremental…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Zhizheng Liu , Mattia Segu , Fisher Yu

Neural networks are achieving state of the art and sometimes super-human performance on learning tasks across a variety of domains. Whenever these problems require learning in a continual or sequential manner, however, neural networks…

Machine Learning · Computer Science 2019-10-17 Mehrdad Farajtabar , Navid Azizan , Alex Mott , Ang Li

Knowledge distillation (KD) has emerged as a promising technique for addressing the computational challenges associated with deploying large-scale recommender systems. KD transfers the knowledge of a massive teacher system to a compact…

Information Retrieval · Computer Science 2024-06-27 Gyuseok Lee , SeongKu Kang , Wonbin Kweon , Hwanjo Yu

There have been several efforts to improve Novelty Detection (ND) performance. However, ND methods often suffer significant performance drops under minor distribution shifts caused by changes in the environment, known as style shifts. This…

Unified Multimodal Generative Models (UMGMs) unify visual understanding and image generation within a single autoregressive framework. However, their ability to continually learn new tasks is severely hindered by catastrophic forgetting,…

Machine Learning · Computer Science 2025-12-04 Xiwen Wei , Mustafa Munir , Radu Marculescu

High-quality pre-training data is crutial for large language models, where quality captures factual reliability and semantic value, and diversity ensures broad coverage and distributional heterogeneity. Existing approaches typically rely on…

Computation and Language · Computer Science 2025-10-23 Hongyi He , Xiao Liu , Zhenghao Lin , Mingni Tang , Yi Cheng , Jintao Wang , Wenjie Li , Peng Cheng , Yeyun Gong

In this study, we tackle Generalized Category Discovery (GCD) via a Relational Retrieval perspective, explicitly coupling labeled and unlabeled data through bidirectional knowledge transfer. While existing methods treat these sources…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yulin Xu , Chunqi Guo , Yuanzhen Shuai , Jianyuan Ni

Object detectors are typically trained once and for all on a fixed set of classes. However, this closed-world assumption is unrealistic in practice, as new classes will inevitably emerge after the detector is deployed in the wild. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Tyler L. Hayes , César R. de Souza , Namil Kim , Jiwon Kim , Riccardo Volpi , Diane Larlus

The Information Bottleneck (IB) provides an information theoretic principle for representation learning, by retaining all information relevant for predicting label while minimizing the redundancy. Though IB principle has been applied to a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Xudong Tian , Zhizhong Zhang , Shaohui Lin , Yanyun Qu , Yuan Xie , Lizhuang Ma

Continual learning methods used to force neural networks to process sequential tasks in isolation, preventing them from leveraging useful inter-task relationships and causing them to repeatedly relearn similar features or overly…

Machine Learning · Computer Science 2025-11-14 Hyung-Jun Moon , Sung-Bae Cho

The primary objective of Continual Anomaly Detection (CAD) is to learn the normal patterns of new tasks under dynamic data distribution assumptions while mitigating catastrophic forgetting. Existing embedding-based CAD approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Gen Yang , Zhipeng Deng , Junfeng Man