English
Related papers

Related papers: Density Map Distillation for Incremental Object Co…

200 papers

Multi-task learns multiple tasks, while sharing knowledge and computation among them. However, it suffers from catastrophic forgetting of previous knowledge when learned incrementally without access to the old data. Most existing object…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Xialei Liu , Hao Yang , Avinash Ravichandran , Rahul Bhotika , Stefano Soatto

Traditional object detection are ill-equipped for incremental learning. However, fine-tuning directly on a well-trained detection model with only new data will leads to catastrophic forgetting. Knowledge distillation is a straightforward…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Tao Feng , Mang Wang

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

Machine Learning · Computer Science 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

A fundamental and challenging problem in deep learning is catastrophic forgetting, i.e. the tendency of neural networks to fail to preserve the knowledge acquired from old tasks when learning new tasks. This problem has been widely…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Guanglei Yang , Enrico Fini , Dan Xu , Paolo Rota , Mingli Ding , Moin Nabi , Xavier Alameda-Pineda , Elisa Ricci

In real applications, new object classes often emerge after the detection model has been trained on a prepared dataset with fixed classes. Due to the storage burden and the privacy of old data, sometimes it is impractical to train the model…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Dongbao Yang , Yu Zhou , Weiping Wang

This paper investigates the problem of class-incremental object detection for agricultural applications where a model needs to learn new plant species and diseases incrementally without forgetting the previously learned ones. We adapt two…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Mathieu Pagé Fortin

In a real-world setting, object instances from new classes can be continuously encountered by object detectors. When existing object detectors are applied to such scenarios, their performance on old classes deteriorates significantly. A few…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 K J Joseph , Jathushan Rajasegaran , Salman Khan , Fahad Shahbaz Khan , Vineeth N Balasubramanian

Traditional object detectors are ill-equipped for incremental learning. However, fine-tuning directly on a well-trained detection model with only new data will lead to catastrophic forgetting. Knowledge distillation is a flexible way to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Tao Feng , Mang Wang , Hangjie Yuan

Over the past years, semantic segmentation, as many other tasks in computer vision, benefited from the progress in deep neural networks, resulting in significantly improved performance. However, deep architectures trained with…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Guanglei Yang , Enrico Fini , Dan Xu , Paolo Rota , Mingli Ding , Hao Tang , Xavier Alameda-Pineda , Elisa Ricci

Deep learning architectures have shown remarkable results in scene understanding problems, however they exhibit a critical drop of performances when they are required to learn incrementally new tasks without forgetting old ones. This…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Umberto Michieli , Pietro Zanuttigh

Continual learning, involving sequential training on diverse tasks, often faces catastrophic forgetting. While knowledge distillation-based approaches exhibit notable success in preventing forgetting, we pinpoint a limitation in their…

Machine Learning · Computer Science 2024-05-17 Zenglin Shi , Pei Liu , Tong Su , Yunpeng Wu , Kuien Liu , Yu Song , Meng Wang

Despite the recent advances in the field of object detection, common architectures are still ill-suited to incrementally detect new categories over time. They are vulnerable to catastrophic forgetting: they forget what has been already…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Fabio Cermelli , Antonino Geraci , Dario Fontanel , Barbara Caputo

In continual learning, there is a serious problem of catastrophic forgetting, in which previous knowledge is forgotten when a model learns new tasks. Various methods have been proposed to solve this problem. Replay methods which replay data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Kotaro Nagata , Hiromu Ono , Kazuhiro Hotta

Incremental learning requires a model to continually learn new tasks from streaming data. However, traditional fine-tuning of a well-trained deep neural network on a new task will dramatically degrade performance on the old task -- a…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Can Peng , Kun Zhao , Sam Maksoud , Meng Li , Brian C. Lovell

Modern object detection methods based on convolutional neural network suffer from severe catastrophic forgetting in learning new classes without original data. Due to time consumption, storage burden and privacy of old data, it is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Dongbao Yang , Yu Zhou , Dayan Wu , Can Ma , Fei Yang , Weiping Wang

Training models continually to detect and classify objects, from new classes and new domains, remains an open problem. In this work, we conduct a thorough analysis of why and how object detection models forget catastrophically. We focus on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Eli Verwimp , Kuo Yang , Sarah Parisot , Hong Lanqing , Steven McDonagh , Eduardo Pérez-Pellitero , Matthias De Lange , Tinne Tuytelaars

In this paper, we propose a novel training procedure for the continual representation learning problem in which a neural network model is sequentially learned to alleviate catastrophic forgetting in visual search tasks. Our method, called…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Tommaso Barletti , Niccolo' Biondi , Federico Pernici , Matteo Bruni , Alberto Del Bimbo

Modern computer vision applications suffer from catastrophic forgetting when incrementally learning new concepts over time. The most successful approaches to alleviate this forgetting require extensive replay of previously seen data, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 James Smith , Yen-Chang Hsu , Jonathan Balloch , Yilin Shen , Hongxia Jin , Zsolt Kira

Incremental language learning with pseudo-data can alleviate catastrophic forgetting in neural networks. However, to obtain better performance, former methods have higher demands for pseudo-data of the previous tasks. The performance…

Computation and Language · Computer Science 2021-10-19 Han Wang , Ruiliu Fu , Chengzhang Li , Xuejun Zhang , Jun Zhou , Yonghong Yan

Recent advances in object detection have benefited significantly from rapid developments in deep neural networks. However, neural networks suffer from the well-known issue of catastrophic forgetting, which makes continual or lifelong…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Wang Zhou , Shiyu Chang , Norma Sosa , Hendrik Hamann , David Cox
‹ Prev 1 2 3 10 Next ›