English
Related papers

Related papers: Memory-Efficient Incremental Learning Through Feat…

200 papers

Standard deep learning-based classification approaches require collecting all samples from all classes in advance and are trained offline. This paradigm may not be practical in real-world clinical applications, where new classes are…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Sana Ayromlou , Purang Abolmaesumi , Teresa Tsang , Xiaoxiao Li

This paper explores the possibility of extending the capability of pre-trained neural image compressors (e.g., adapting to new data or target bitrates) without breaking backward compatibility, the ability to decode bitstreams encoded by the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-01 Zhihao Duan , Ming Lu , Justin Yang , Jiangpeng He , Zhan Ma , Fengqing Zhu

A common practice in transfer learning is to initialize the downstream model weights by pre-training on a data-abundant upstream task. In object detection specifically, the feature backbone is typically initialized with Imagenet classifier…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Cristina Vasconcelos , Vighnesh Birodkar , Vincent Dumoulin

As neural networks are increasingly being applied to real-world applications, mechanisms to address distributional shift and sequential task learning without forgetting are critical. Methods incorporating network expansion have shown…

Machine Learning · Computer Science 2021-03-26 Vinay Kumar Verma , Kevin J Liang , Nikhil Mehta , Piyush Rai , Lawrence Carin

We target open-world feature extrapolation problem where the feature space of input data goes through expansion and a model trained on partially observed features needs to handle new features in test data without further retraining. The…

Machine Learning · Computer Science 2023-06-14 Qitian Wu , Chenxiao Yang , Junchi Yan

Despite their success for object detection, convolutional neural networks are ill-equipped for incremental learning, i.e., adapting the original model trained on a set of classes to additionally detect objects of new classes, in the absence…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Konstantin Shmelkov , Cordelia Schmid , Karteek Alahari

We address a core problem of computer vision: Detection and description of 2D feature points for image matching. For a long time, hand-crafted designs, like the seminal SIFT algorithm, were unsurpassed in accuracy and efficiency. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Aritra Bhowmik , Stefan Gumhold , Carsten Rother , Eric Brachmann

Recent machine learning techniques have dramatically changed how we process digital images. However, the way in which we capture images is still largely driven by human intuition and experience. This restriction is in part due to the many…

Image and Video Processing · Electrical Eng. & Systems 2020-02-17 Amey Chaware , Colin L. Cooke , Kanghyun Kim , Roarke Horstmeyer

Although data-free incremental learning methods are memory-friendly, accurately estimating and counteracting representation shifts is challenging in the absence of historical data. This paper addresses this thorny problem by proposing a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Zhiheng Ma , Xiaopeng Hong , Beinan Liu , Yabin Wang , Pinyue Guo , Huiyun Li

Deep learning architectures have shown remarkable results in scene understanding problems, however they exhibit a critical drop of performances when they are required to learn incrementally new tasks without forgetting old ones. This…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Umberto Michieli , Pietro Zanuttigh

We present an algorithm that learns representations which explicitly compensate for domain mismatch and which can be efficiently realized as linear classifiers. Specifically, we form a linear transformation that maps features from the…

Machine Learning · Computer Science 2017-11-10 Judy Hoffman , Erik Rodner , Jeff Donahue , Trevor Darrell , Kate Saenko

Humans are capable of learning new tasks without forgetting previous ones, while neural networks fail due to catastrophic forgetting between new and previously-learned tasks. We consider a class-incremental setting which means that the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Xialei Liu , Chenshen Wu , Mikel Menta , Luis Herranz , Bogdan Raducanu , Andrew D. Bagdanov , Shangling Jui , Joost van de Weijer

Deep learning models in recommender systems are usually trained in the batch mode, namely iteratively trained on a fixed-size window of training data. Such batch mode training of deep learning models suffers from low training efficiency,…

Information Retrieval · Computer Science 2020-09-07 Yichao Wang , Huifeng Guo , Ruiming Tang , Zhirong Liu , Xiuqiang He

Class-incremental learning aims to learn new classes in an incremental fashion without forgetting the previously learned ones. Several research works have shown how additional data can be used by incremental models to help mitigate…

Machine Learning · Computer Science 2023-10-11 Quentin Jodelet , Xin Liu , Yin Jun Phua , Tsuyoshi Murata

Modern machine learning suffers from catastrophic forgetting when learning new classes incrementally. The performance dramatically degrades due to the missing data of old classes. Incremental learning methods have been proposed to retain…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Yue Wu , Yinpeng Chen , Lijuan Wang , Yuancheng Ye , Zicheng Liu , Yandong Guo , Yun Fu

Deep learning models suffer from catastrophic forgetting of the classes in the older phases as they get trained on the classes introduced in the new phase in the class-incremental learning setting. In this work, we show that the effect of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Mohammed Asad Karim , Indu Joshi , Pratik Mazumder , Pravendra Singh

Continual learning (CL) aims to extend deep models from static and enclosed environments to dynamic and complex scenarios, enabling systems to continuously acquire new knowledge of novel categories without forgetting previously learned…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Sunyuan Qiang , Xuxin Lin , Yanyan Liang , Jun Wan , Du Zhang

In this paper, we propose a machine learning model, which dynamically changes the features during training. Our main motivation is to update the model in a small content during the training process with replacing less descriptive features…

Machine Learning · Computer Science 2020-02-24 Marcell Beregi-Kovács , Ágnes Baran , András Hajdu

Incremental Learning scenarios do not always represent real-world inference use-cases, which tend to have less strict task boundaries, and exhibit repetition of common classes and concepts in their continual data stream. To better represent…

Machine Learning · Computer Science 2025-02-28 Benedikt Tscheschner , Eduardo Veas , Marc Masana

Off-the-shelf convolutional neural network features achieve outstanding results in many image retrieval tasks. However, their invariance to target data is pre-defined by the network architecture and training data. Existing image retrieval…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Osman Tursun , Simon Denman , Sridha Sridharan , Clinton Fookes