English
Related papers

Related papers: Incremental Concept Formation over Visual Images W…

200 papers

Traditional supervised learning with deep neural networks requires a tremendous amount of labelled data to converge to a good solution. For 3D medical images, it is often impractical to build a large homogeneous annotated dataset for a…

Deep neural networks (DNNs) often suffer from "catastrophic forgetting" during incremental learning (IL) --- an abrupt degradation of performance on the original set of classes when the training objective is adapted to a newly added set of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 Junting Zhang , Jie Zhang , Shalini Ghosh , Dawei Li , Serafettin Tasci , Larry Heck , Heming Zhang , C. -C. Jay Kuo

In many real-world scenarios, data to train machine learning models become available over time. However, neural network models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon…

Machine Learning · Computer Science 2022-06-29 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

Humans have the ability to learn novel compositional concepts by recalling and generalizing primitive concepts acquired from past experiences. Inspired by this observation, in this paper, we propose MetaReVision, a retrieval-enhanced…

Computation and Language · Computer Science 2023-11-06 Guangyue Xu , Parisa Kordjamshidi , Joyce Chai

Generative learning has advanced network neuroscience, enabling tasks like graph super-resolution, temporal graph prediction, and multimodal brain graph fusion. However, current methods, mainly based on graph neural networks (GNNs), focus…

Machine Learning · Computer Science 2025-09-16 Mayssa Soussia , Yijun Lin , Mohamed Ali Mahjoub , Islem Rekik

Catastrophic forgetting is a significant challenge in the field of machine learning, particularly in neural networks. When a neural network learns to perform well on a new task, it often forgets its previously acquired knowledge or…

Machine Learning · Computer Science 2023-12-04 Nuri Korhan , Ceren Öner

In this paper, we propose a novel training procedure for the continual representation learning problem in which a neural network model is sequentially learned to alleviate catastrophic forgetting in visual search tasks. Our method, called…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Tommaso Barletti , Niccolo' Biondi , Federico Pernici , Matteo Bruni , Alberto Del Bimbo

Continual learning refers to the capability of a machine learning model to learn and adapt to new information, without compromising its performance on previously learned tasks. Although several studies have investigated continual learning…

Information Retrieval · Computer Science 2024-06-21 Jingrui Hou , Georgina Cosma , Axel Finke

In order for artificial neural networks to begin accurately mimicking biological ones, they must be able to adapt to new exigencies without forgetting what they have learned from previous training. Lifelong learning approaches to artificial…

Machine Learning · Computer Science 2022-12-27 Gabriel Mantione-Holmes , Justin Leo , Jugal Kalita

By and large, existing computational models of visual attention tacitly assume perfect vision and full access to the stimulus and thereby deviate from foveated biological vision. Moreover, modeling top-down attention is generally reduced to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Leo Schwinn , Doina Precup , Björn Eskofier , Dario Zanca

Neural networks are prone to catastrophic forgetting when trained incrementally on different tasks. Popular incremental learning methods mitigate such forgetting by retaining a subset of previously seen samples and replaying them during the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Kevin Thandiackal , Tiziano Portenier , Andrea Giovannini , Maria Gabrani , Orcun Goksel

Recent years have witnessed the great success of convolutional neural network (CNN) based models in the field of computer vision. CNN is able to learn hierarchically abstracted features from images in an end-to-end training manner. However,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Xin Li , Zequn Jie , Jiashi Feng , Changsong Liu , Shuicheng Yan

Supervised deep neural networks are known to undergo a sharp decline in the accuracy of older tasks when new tasks are learned, termed "catastrophic forgetting". Many state-of-the-art solutions to continual learning rely on biasing and/or…

Machine Learning · Computer Science 2020-11-11 Amanda Rios , Laurent Itti

The maturity of deep learning techniques has led in recent years to a breakthrough in object recognition in visual media. While for some specific benchmarks, neural techniques seem to match if not outperform human judgement, challenges are…

Information Retrieval · Computer Science 2016-06-01 Sanchit Arora , Chuck Cho , Paul Fitzpatrick , Francois Scharffe

Unsupervised video class incremental learning (uVCIL) represents an important learning paradigm for learning video information without forgetting, and without considering any data labels. Prior approaches have focused on supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Nattapong Kurpukdee , Adrian G. Bors

The ability to quickly learn new knowledge (e.g. new classes or data distributions) is a big step towards human-level intelligence. In this paper, we consider scenarios that require learning new classes or data distributions quickly and…

Machine Learning · Computer Science 2021-09-13 Fei Mi , Tao Lin , Boi Faltings

Deep Learning models have achieved remarkable performance in tasks such as image classification or generation, often surpassing human accuracy. However, they can struggle to learn new tasks and update their knowledge without access to…

Machine Learning · Computer Science 2023-12-19 Everton L. Aleixo , Juan G. Colonna , Marco Cristo , Everlandio Fernandes

While advanced image captioning systems are increasingly describing images coherently and exactly, recent progress in continual learning allows deep learning models to avoid catastrophic forgetting. However, the domain where image…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Giang Nguyen , Tae Joon Jun , Trung Tran , Tolcha Yalew , Daeyoung Kim

Recent advances in deep learning have shown exciting promise in filling large holes and lead to another orientation for image inpainting. However, existing learning-based methods often create artifacts and fallacious textures because of…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Qingguo Xiao , Guangyao Li , Qiaochuan Chen

The increasing impact of black box models, and particularly of unsupervised ones, comes with an increasing interest in tools to understand and interpret them. In this paper, we consider in particular how to characterise visual groupings…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Iro Laina , Ruth C. Fong , Andrea Vedaldi