English
Related papers

Related papers: Faster ILOD: Incremental Learning for Object Detec…

200 papers

Deep convolutional neural networks (DCNNs) are an influential tool for solving various problems in the machine learning and computer vision fields. In this paper, we introduce a new deep learning model called an Inception- Recurrent…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Md Zahangir Alom , Mahmudul Hasan , Chris Yakopcic , Tarek M. Taha

The field of continual deep learning is an emerging field and a lot of progress has been made. However, concurrently most of the approaches are only tested on the task of image classification, which is not relevant in the field of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Tobias Kalb , Masoud Roschani , Miriam Ruf , Jürgen Beyerer

Knowledge distillation is a widely used paradigm for inheriting information from a complicated teacher network to a compact student network and maintaining the strong performance. Different from image classification, object detectors are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Jianyuan Guo , Kai Han , Yunhe Wang , Han Wu , Xinghao Chen , Chunjing Xu , Chang Xu

Weakly supervised object detection (WSOD) aims to tackle the object detection problem using only labeled image categories as supervision. A common approach used in WSOD to deal with the lack of localization information is Multiple Instance…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Luis Felipe Zeni , Claudio Jung

Incremental learning targets at achieving good performance on new categories without forgetting old ones. Knowledge distillation has been shown critical in preserving the performance on old classes. Conventional methods, however,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Peng Zhou , Long Mai , Jianming Zhang , Ning Xu , Zuxuan Wu , Larry S. Davis

Despite the recent advances in the field of object detection, common architectures are still ill-suited to incrementally detect new categories over time. They are vulnerable to catastrophic forgetting: they forget what has been already…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Fabio Cermelli , Antonino Geraci , Dario Fontanel , Barbara Caputo

It has been well recognized that modeling object-to-object relations would be helpful for object detection. Nevertheless, the problem is not trivial especially when exploring the interactions between objects to boost video object detectors.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Jiajun Deng , Yingwei Pan , Ting Yao , Wengang Zhou , Houqiang Li , Tao Mei

Knowledge distillation learns a lightweight student model that mimics a cumbersome teacher. Existing methods regard the knowledge as the feature of each instance or their relations, which is the instance-level knowledge only from the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Sanli Tang , Zhongyu Zhang , Zhanzhan Cheng , Jing Lu , Yunlu Xu , Yi Niu , Fan He

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

Machine Learning · Computer Science 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

Incremental learning is a form of online learning. Incremental learning can modify the parameters and structure of the deep learning model so that the model does not forget the old knowledge while learning new knowledge. Preventing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Sheng Ren , Yan He , Neal N. Xiong , Kehua Guo

State-of-the-art object detection networks depend on region proposal algorithms to hypothesize object locations. Advances like SPPnet and Fast R-CNN have reduced the running time of these detection networks, exposing region proposal…

Computer Vision and Pattern Recognition · Computer Science 2016-01-07 Shaoqing Ren , Kaiming He , Ross Girshick , Jian Sun

Knowledge Distillation (KD) for object detection aims to train a compact detector by transferring knowledge from a teacher model. Since the teacher model perceives data in a way different from humans, existing KD methods only distill…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jiawei Liang , Siyuan Liang , Aishan Liu , Ke Ma , Jingzhi Li , Xiaochun Cao

Knowledge distillation is an effective method for model compression. However, it is still a challenging topic to apply knowledge distillation to detection tasks. There are two key points resulting in poor distillation performance for…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Zhenliang Ni , Fukui Yang , Shengzhao Wen , Gang Zhang

Incremental learning methods can learn new classes continually by distilling knowledge from the last model (as a teacher model) to the current model (as a student model) in the sequentially learning process. However, these methods cannot…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Longhui Yu , Zhenyu Weng , Yuqing Wang , Yuesheng Zhu

Convolutional neural networks have a significant improvement in the accuracy of Object detection. As convolutional neural networks become deeper, the accuracy of detection is also obviously improved, and more floating-point calculations are…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Wei Hong , Jin ke Yu Fan Zong

Effectively structuring deep knowledge plays a pivotal role in transfer from teacher to student, especially in semantic vision tasks. In this paper, we present a simple knowledge structure to exploit and encode information inside the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Yixin Chen , Pengguang Chen , Shu Liu , Liwei Wang , Jiaya Jia

Visual prompt-based methods have seen growing interest in incremental learning (IL) for image classification. These approaches learn additional embedding vectors while keeping the model frozen, making them efficient to train. However, no…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Matthias Neuwirth-Trapp , Maarten Bieshaar , Danda Pani Paudel , Luc Van Gool

Knowledge distillation constitutes a simple yet effective way to improve the performance of a compact student network by exploiting the knowledge of a more powerful teacher. Nevertheless, the knowledge distillation literature remains…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Shuxuan Guo , Jose M. Alvarez , Mathieu Salzmann

Modern deep learning approaches have achieved great success in many vision applications by training a model using all available task-specific data. However, there are two major obstacles making it challenging to implement for real life…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Jiangpeng He , Runyu Mao , Zeman Shao , Fengqing Zhu

We investigate the problem of incremental learning for object counting, where a method must learn to count a variety of object classes from a sequence of datasets. A na\"ive approach to incremental object counting would suffer from…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Chenshen Wu , Joost van de Weijer