English
Related papers

Related papers: Class Incremental Continual Learning with Self-Org…

200 papers

While neural networks trained for semantic segmentation are essential for perception in autonomous driving, most current algorithms assume a fixed number of classes, presenting a major limitation when developing new autonomous driving…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Marvin Klingner , Andreas Bär , Philipp Donn , Tim Fingscheidt

In class-incremental learning, the objective is to learn a number of classes sequentially without having access to the whole training data. However, due to a problem known as catastrophic forgetting, neural networks suffer substantial…

Machine Learning · Computer Science 2021-06-01 Sobirdzhon Bobiev , Adil Khan , Syed Muhammad Ahsan Raza Kazmi

Class Incremental Learning (CIL) aims to sequentially learn new classes while avoiding catastrophic forgetting of previous knowledge. We propose to use Masked Autoencoders (MAEs) as efficient learners for CIL. MAEs were originally designed…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Jiang-Tian Zhai , Xialei Liu , Andrew D. Bagdanov , Ke Li , Ming-Ming Cheng

The idea of reusing information from previously learned tasks (source tasks) for the learning of new tasks (target tasks) has the potential to significantly improve the sample efficiency reinforcement learning agents. In this work, we…

Machine Learning · Computer Science 2018-07-21 Thommen George Karimpanal , Roland Bouffanais

The exemplar-free class incremental learning requires classification models to learn new class knowledge incrementally without retaining any old samples. Recently, the framework based on parallel one-class classifiers (POC), which trains a…

Machine Learning · Computer Science 2025-01-28 Wenju Sun , Qingyong Li , Jing Zhang , Danyu Wang , Wen Wang , Yangli-ao Geng

Anomaly detection plays a key role in industrial manufacturing for product quality control. Traditional methods for anomaly detection are rule-based with limited generalization ability. Recent methods based on supervised deep learning are…

Computer Vision and Pattern Recognition · Computer Science 2021-07-22 Ning Li , Kaitao Jiang , Zhiheng Ma , Xing Wei , Xiaopeng Hong , Yihong Gong

Continual learning in online scenario aims to learn a sequence of new tasks from data stream using each data only once for training, which is more realistic than in offline mode assuming data from new task are all available. However, this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Jiangpeng He , Fengqing Zhu

As image-based deep learning becomes pervasive on every device, from cell phones to smart watches, there is a growing need to develop methods that continually learn from data while minimizing memory footprint and power consumption. While…

Machine Learning · Computer Science 2021-03-24 Dongsub Shim , Zheda Mai , Jihwan Jeong , Scott Sanner , Hyunwoo Kim , Jongseong Jang

This paper presents a generative approach to speech enhancement based on a recurrent variational autoencoder (RVAE). The deep generative speech model is trained using clean speech signals only, and it is combined with a nonnegative matrix…

Machine Learning · Computer Science 2020-02-11 Simon Leglaive , Xavier Alameda-Pineda , Laurent Girin , Radu Horaud

There has been an increasing interest in semi-supervised learning in the recent years because of the great number of datasets with a large number of unlabeled data but only a few labeled samples. Semi-supervised learning algorithms can work…

Machine Learning · Computer Science 2020-03-26 Pedro H. M. Braga , Hansenclever F. Bassani

Self-organizing maps (SOMs) are a technique that has been used with high-dimensional data vectors to develop an archetypal set of states (nodes) that span, in some sense, the high-dimensional space. Noteworthy applications include weather…

Applications · Statistics 2009-01-23 Huiyan Sang , Alan E. Gelfand , Chris Lennard , Gabriele Hegerl , Bruce Hewitson

Continual learning consists in incrementally training a model on a sequence of datasets and testing on the union of all datasets. In this paper, we examine continual learning for the problem of sound classification, in which we wish to…

Machine Learning · Computer Science 2019-06-04 Zhepei Wang , Cem Subakan , Efthymios Tzinis , Paris Smaragdis , Laurent Charlin

Recent advances in a generative neural network model extend the development of data augmentation methods. However, the augmentation methods based on the modern generative models fail to achieve notable performance for class imbalance data…

Machine Learning · Computer Science 2025-07-08 Sungchul Hong , Seunghwan An , Jong-June Jeon

The two main impediments to continual learning are catastrophic forgetting and memory limitations on the storage of data. To cope with these challenges, we propose a novel, cognitively-inspired approach which trains autoencoders with Neural…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Ali Ayub , Alan R. Wagner

Non-exemplar class-incremental learning refers to classifying new and old classes without storing samples of old classes. Since only new class samples are available for optimization, it often occurs catastrophic forgetting of old knowledge.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Ke Song , Quan Xia , Guoqiang Liang , Zhaojie Chen , Yanning Zhang

Generative Artificial Intelligence (AI) models are a compelling way to introduce K-12 students to AI education using an artistic medium, and hence have drawn attention from K-12 AI educators. Previous Creative AI curricula mainly focus on…

Computers and Society · Computer Science 2022-01-07 Zhuoyue Lyu , Safinah Ali , Cynthia Breazeal

Continual Semantic Segmentation (CSS) extends static semantic segmentation by incrementally introducing new classes for training. To alleviate the catastrophic forgetting issue in CSS, a memory buffer that stores a small number of samples…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Lanyun Zhu , Tianrun Chen , Jianxiong Yin , Simon See , Jun Liu

This paper describes a statistically-principled semi-supervised method of automatic chord estimation (ACE) that can make effective use of music signals regardless of the availability of chord annotations. The typical approach to ACE is to…

Sound · Computer Science 2020-09-09 Yiming Wu , Tristan Carsault , Eita Nakamura , Kazuyoshi Yoshii

Existing methods of level generation using latent variable models such as VAEs and GANs do so in segments and produce the final level by stitching these separately generated segments together. In this paper, we build on these methods by…

Machine Learning · Computer Science 2020-07-20 Anurag Sarkar , Seth Cooper

Enhancing the instruction-following ability of Large Language Models (LLMs) primarily demands substantial instruction-tuning datasets. However, the sheer volume of these imposes a considerable computational burden and annotation cost. To…

Computation and Language · Computer Science 2023-11-15 Shengguang Wu , Keming Lu , Benfeng Xu , Junyang Lin , Qi Su , Chang Zhou