English
Related papers

Related papers: Two-Level Residual Distillation based Triple Netwo…

200 papers

A fundamental and challenging problem in deep learning is catastrophic forgetting, i.e. the tendency of neural networks to fail to preserve the knowledge acquired from old tasks when learning new tasks. This problem has been widely…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Guanglei Yang , Enrico Fini , Dan Xu , Paolo Rota , Mingli Ding , Moin Nabi , Xavier Alameda-Pineda , Elisa Ricci

In spite of remarkable success of the convolutional neural networks on semantic segmentation, they suffer from catastrophic forgetting: a significant performance drop for the already learned classes when new classes are added on the data,…

Machine Learning · Computer Science 2019-11-28 Onur Tasar , Yuliya Tarabalka , Pierre Alliez

Object detection limits its recognizable categories during the training phase, in which it can not cover all objects of interest for users. To satisfy the practical necessity, the incremental learning ability of the detector becomes a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Zhenwei He , Lei Zhang

Deep learning models generally display catastrophic forgetting when learning new data continuously. Many incremental learning approaches address this problem by reusing data from previous tasks while learning new tasks. However, the direct…

Machine Learning · Computer Science 2024-11-12 Young Jo Choi , Min Kyoon Yoo , Yu Rang Park

Object detection models shipped with camera-equipped edge devices cannot cover the objects of interest for every user. Therefore, the incremental learning capability is a critical feature for a robust and personalized object detection…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Dawei Li , Serafettin Tasci , Shalini Ghosh , Jingwen Zhu , Junting Zhang , Larry Heck

Deep learning-based approaches have shown remarkable performance in the 3D object detection task. However, they suffer from a catastrophic performance drop on the originally trained classes when incrementally learning new classes without…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Na Zhao , Gim Hee Lee

Current methods for incremental object detection (IOD) primarily rely on Faster R-CNN or DETR series detectors; however, these approaches do not accommodate the real-time YOLO detection frameworks. In this paper, we first identify three…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Shizhou Zhang , Xueqiang Lv , Yinghui Xing , Qirui Wu , Di Xu , Chen Zhao , Yanning Zhang

Continual learning seeks to maintain stable adaptation under non-stationary environments, yet this problem becomes particularly challenging in object detection, where most existing methods implicitly assume relatively balanced visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Rangya Zhang , Jiaping Xiao , Lu Bai , Yuhang Zhang , Mir Feroskhan

Machine learning classifiers are often trained to recognize a set of pre-defined classes. However, in many applications, it is often desirable to have the flexibility of learning additional concepts, with limited data and without…

Machine Learning · Computer Science 2019-10-08 Mengye Ren , Renjie Liao , Ethan Fetaya , Richard S. Zemel

Continual Learning (CL) focuses on developing algorithms with the ability to adapt to new environments and learn new skills. This very challenging task has generated a lot of interest in recent years, with new solutions appearing rapidly.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Jinxiang Lai , Wenlong Liu , Jun Liu

The ability to learn from incrementally arriving data is essential for any life-long learning system. However, standard deep neural networks forget the knowledge about the old tasks, a phenomenon called catastrophic forgetting, when trained…

Computer Vision and Pattern Recognition · Computer Science 2018-07-12 Haseeb Shah , Khurram Javed , Faisal Shafait

This paper presents a novel way of online adapting any off-the-shelf object detection model to a novel domain without retraining the detector model. Inspired by how humans quickly learn knowledge of a new subject (e.g., memorization), we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Yanan Jian , Fuxun Yu , Qi Zhang , William Levine , Brandon Dubbs , Nikolaos Karianakis

In the current salient object detection network, the most popular method is using U-shape structure. However, the massive number of parameters leads to more consumption of computing and storage resources which are not feasible to deploy on…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Bin Zhang , Yang Wu , Xiaojing Zhang , Ming Ma

Modern computer vision applications suffer from catastrophic forgetting when incrementally learning new concepts over time. The most successful approaches to alleviate this forgetting require extensive replay of previously seen data, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 James Smith , Yen-Chang Hsu , Jonathan Balloch , Yilin Shen , Hongxia Jin , Zsolt Kira

3D object recognition has successfully become an appealing research topic in the real-world. However, most existing recognition models unreasonably assume that the categories of 3D objects cannot change over time in the real-world. This…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Jiahua Dong , Yang Cong , Gan Sun , Lixu Wang , Lingjuan Lyu , Jun Li , Ender Konukoglu

In this paper, we propose a novel training procedure for the continual representation learning problem in which a neural network model is sequentially learned to alleviate catastrophic forgetting in visual search tasks. Our method, called…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Tommaso Barletti , Niccolo' Biondi , Federico Pernici , Matteo Bruni , Alberto Del Bimbo

While many works on Continual Learning have shown promising results for mitigating catastrophic forgetting, they have relied on supervised training. To successfully learn in a label-agnostic incremental setting, a model must distinguish…

Machine Learning · Computer Science 2021-12-09 Shivam Khare , Kun Cao , James Rehg

Lifelong learning with deep neural networks is well-known to suffer from catastrophic forgetting: the performance on previous tasks drastically degrades when learning a new task. To alleviate this effect, we propose to leverage a large…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Kibok Lee , Kimin Lee , Jinwoo Shin , Honglak Lee

Neural networks notoriously suffer from the problem of catastrophic forgetting, the phenomenon of forgetting the past knowledge when acquiring new knowledge. Overcoming catastrophic forgetting is of significant importance to emulate the…

Machine Learning · Computer Science 2021-04-20 Christian Simon , Piotr Koniusz , Mehrtash Harandi

In incremental object detection, knowledge distillation has been proven to be an effective way to alleviate catastrophic forgetting. However, previous works focused on preserving the knowledge of old models, ignoring that images could…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Qijie Mo , Yipeng Gao , Shenghao Fu , Junkai Yan , Ancong Wu , Wei-Shi Zheng