English
Related papers

Related papers: Multi-View Correlation Distillation for Incrementa…

200 papers

Classical object detectors are incapable of detecting novel class objects that are not encountered before. Regarding this issue, Open-Vocabulary Object Detection (OVOD) is proposed, which aims to detect the objects in the candidate class…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Zhao Wang , Aoxue Li , Fengwei Zhou , Zhenguo Li , Qi Dou

Image-based object pose estimation sounds amazing because in real applications the shape of object is oftentimes not available or not easy to take like photos. Although it is an advantage to some extent, un-explored shape information in 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Zhidan Liu , Zhen Xing , Xiangdong Zhou , Yijiang Chen , Guichun Zhou

We tackle catastrophic forgetting problem in the context of class-incremental learning for video recognition, which has not been explored actively despite the popularity of continual learning. Our framework addresses this challenging task…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Jaeyoo Park , Minsoo Kang , Bohyung Han

Class-incremental with repetition (CIR), where previously trained classes repeatedly introduced in future tasks, is a more realistic scenario than the traditional class incremental setup, which assumes that each task contains unseen…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Taeheon Kim , San Kim , Minhyuk Seo , Dongjae Jeon , Wonje Jeung , Jonghyun Choi

We tackle the problem of novel class discovery, which aims to learn novel classes without supervision based on labeled data from known classes. A key challenge lies in transferring the knowledge in the known-class data to the learning of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Peiyan Gu , Chuyu Zhang , Ruijie Xu , Xuming He

Connecting multiple machine learning models into a pipeline is effective for handling complex problems. By breaking down the problem into steps, each tackled by a specific component model of the pipeline, the overall solution can be made…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Tomoe Kishimoto , Masahiko Saito , Junichi Tanaka , Yutaro Iiyama , Ryu Sawada , Koji Terashi

The field of Continual Learning investigates the ability to learn consecutive tasks without losing performance on those previously learned. Its focus has been mainly on incremental classification tasks. We believe that research in continual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Angelo G. Menezes , Gustavo de Moura , Cézanne Alves , André C. P. L. F. de Carvalho

Knowledge distillation is a widely used paradigm for inheriting information from a complicated teacher network to a compact student network and maintaining the strong performance. Different from image classification, object detectors are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Jianyuan Guo , Kai Han , Yunhe Wang , Han Wu , Xinghao Chen , Chunjing Xu , Chang Xu

Continual learning allows a model to learn multiple tasks sequentially while retaining the old knowledge without the training data of the preceding tasks. This paper extends the scope of continual learning research to class-incremental…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Zhizheng Liu , Mattia Segu , Fisher Yu

Benefiting from masked visual modeling, self-supervised video representation learning has achieved remarkable progress. However, existing methods focus on learning representations from scratch through reconstructing low-level features like…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Rui Wang , Dongdong Chen , Zuxuan Wu , Yinpeng Chen , Xiyang Dai , Mengchen Liu , Lu Yuan , Yu-Gang Jiang

Distribution matching distillation (DMD) facilitates few-step image generation by aligning a distilled student with a reference multi-step teacher. In practice, however, optimizing DMD can reduce sample diversity in few-step synthesis, and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Tianhe Wu , Ruibin Li , Lei Zhang , Kede Ma

We explore the problem of Incremental Generalized Category Discovery (IGCD). This is a challenging category incremental learning setting where the goal is to develop models that can correctly categorize images from previously seen…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Bingchen Zhao , Oisin Mac Aodha

The main purpose of incremental learning is to learn new knowledge while not forgetting the knowledge which have been learned before. At present, the main challenge in this area is the catastrophe forgetting, namely the network will lose…

Machine Learning · Computer Science 2019-06-13 Qiuyu Zhu , Zikuang He , Xin Ye

Unsupervised object-centric learning methods allow the partitioning of scenes into entities without additional localization information and are excellent candidates for reducing the annotation burden of multiple-object tracking (MOT)…

Continual learning, involving sequential training on diverse tasks, often faces catastrophic forgetting. While knowledge distillation-based approaches exhibit notable success in preventing forgetting, we pinpoint a limitation in their…

Machine Learning · Computer Science 2024-05-17 Zenglin Shi , Pei Liu , Tong Su , Yunpeng Wu , Kuien Liu , Yu Song , Meng Wang

Previous knowledge distillation (KD) methods for object detection mostly focus on feature imitation instead of mimicking the prediction logits due to its inefficiency in distilling the localization information. In this paper, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Zhaohui Zheng , Rongguang Ye , Qibin Hou , Dongwei Ren , Ping Wang , Wangmeng Zuo , Ming-Ming Cheng

As the field continues its push for ever more resources, this work turns the spotlight on a critical question: how can vision-language models (VLMs) be adapted to thrive in low-resource, budget-constrained settings? While large VLMs offer…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Zhiqi Kang , Rahaf Aljundi , Vaggelis Dorovatas , Karteek Alahari

Self-supervised representation learning has proved to be a valuable component for out-of-distribution (OoD) detection with only the texts of in-distribution (ID) examples. These approaches either train a language model from scratch or…

Computation and Language · Computer Science 2023-06-05 Qianhui Wu , Huiqiang Jiang , Haonan Yin , Börje F. Karlsson , Chin-Yew Lin

Visual prompt-based methods have seen growing interest in incremental learning (IL) for image classification. These approaches learn additional embedding vectors while keeping the model frozen, making them efficient to train. However, no…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Matthias Neuwirth-Trapp , Maarten Bieshaar , Danda Pani Paudel , Luc Van Gool

Existing Incremental Object Detection (IOD) methods partially alleviate catastrophic forgetting when incrementally detecting new objects in real-world scenarios. However, many of these methods rely on the assumption that unlabeled old-class…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zijia An , Boyu Diao , Libo Huang , Ruiqi Liu , Zhulin An , Yongjun Xu