English
Related papers

Related papers: Online incremental learning for audio classificati…

200 papers

Continual Learning, also known as Lifelong Learning, aims to continually learn from new data as it becomes available. While prior research on continual learning in automatic speech recognition has focused on the adaptation of models across…

Machine Learning · Computer Science 2022-07-13 Muqiao Yang , Ian Lane , Shinji Watanabe

Incremental learning of semantic segmentation has emerged as a promising strategy for visual scene interpretation in the open- world setting. However, it remains challenging to acquire novel classes in an online fashion for the segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Shipeng Yan , Jiale Zhou , Jiangwei Xie , Songyang Zhang , Xuming He

The ability of humans for lifelong learning is an inspiration for deep learning methods and in particular for continual learning. In this work, we apply Hebbian learning, a biologically inspired learning process, to sound classification. We…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-21 Riccardo Casciotti , Francesco De Santis , Alberto Antonietti , Annamaria Mesaros

The absence of large labeled datasets remains a significant challenge in many application areas of deep learning. Researchers and practitioners typically resort to transfer learning and data augmentation to alleviate this issue. We study…

Sound · Computer Science 2022-11-01 Paul Primus , Gerhard Widmer

In this paper, we consider the problem of fine-grained image retrieval in an incremental setting, when new categories are added over time. On the one hand, repeatedly training the representation on the extended dataset is time-consuming. On…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Wei Chen , Yu Liu , Weiping Wang , Tinne Tuytelaars , Erwin M. Bakker , Michael Lew

End-to-end acoustic-to-word speech recognition models have recently gained popularity because they are easy to train, scale well to large amounts of training data, and do not require a lexicon. In addition, word models may also be easier to…

Computation and Language · Computer Science 2019-02-20 Shruti Palaskar , Vikas Raunak , Florian Metze

New classes of sounds constantly emerge with a few samples, making it challenging for models to adapt to dynamic acoustic environments. This challenge motivates us to address the new problem of few-shot class-incremental audio…

Sound · Computer Science 2023-05-30 Wei Xie , Yanxiong Li , Qianhua He , Wenchang Cao , Tuomas Virtanen

Intent classification is a task in spoken language understanding. An intent classification system is usually implemented as a pipeline process, with a speech recognition module followed by text processing that classifies the intents. There…

Computation and Language · Computer Science 2021-02-16 Bidisha Sharma , Maulik Madhavi , Haizhou Li

Continual learning consists in incrementally training a model on a sequence of datasets and testing on the union of all datasets. In this paper, we examine continual learning for the problem of sound classification, in which we wish to…

Machine Learning · Computer Science 2019-06-04 Zhepei Wang , Cem Subakan , Efthymios Tzinis , Paris Smaragdis , Laurent Charlin

We propose a novel class incremental learning approach by incorporating a feature augmentation technique motivated by adversarial attacks. We employ a classifier learned in the past to complement training examples rather than simply play a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Taehoon Kim , Jaeyoo Park , Bohyung Han

This paper presents a new learning strategy for the Sound Event Detection (SED) system to tackle the issues of i) knowledge migration from a pre-trained model to a new target model and ii) learning new sound events without forgetting the…

Machine Learning · Computer Science 2020-03-30 Eunjeong Koh , Fatemeh Saki , Yinyi Guo , Cheng-Yu Hung , Erik Visser

Although deep learning approaches have stood out in recent years due to their state-of-the-art results, they continue to suffer from catastrophic forgetting, a dramatic decrease in overall performance when training with new classes added…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Francisco M. Castro , Manuel J. Marín-Jiménez , Nicolás Guil , Cordelia Schmid , Karteek Alahari

Despite rapid advances in continual learning, a large body of research is devoted to improving performance in the existing setups. While a handful of work do propose new continual learning setups, they still lack practicality in certain…

Machine Learning · Computer Science 2022-03-22 Hyunseo Koh , Dahyun Kim , Jung-Woo Ha , Jonghyun Choi

Continual learning involves training neural networks incrementally for new tasks while retaining the knowledge of previous tasks. However, efficiently fine-tuning the model for sequential tasks with minimal computational resources remains a…

Sound · Computer Science 2024-01-03 Nithish Muthuchamy Selvaraj , Xiaobao Guo , Adams Kong , Bingquan Shen , Alex Kot

In class-incremental learning, the objective is to learn a number of classes sequentially without having access to the whole training data. However, due to a problem known as catastrophic forgetting, neural networks suffer substantial…

Machine Learning · Computer Science 2021-06-01 Sobirdzhon Bobiev , Adil Khan , Syed Muhammad Ahsan Raza Kazmi

Standard deep learning-based classification approaches require collecting all samples from all classes in advance and are trained offline. This paradigm may not be practical in real-world clinical applications, where new classes are…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Sana Ayromlou , Purang Abolmaesumi , Teresa Tsang , Xiaoxiao Li

Modern deep learning approaches have achieved great success in many vision applications by training a model using all available task-specific data. However, there are two major obstacles making it challenging to implement for real life…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Jiangpeng He , Runyu Mao , Zeman Shao , Fengqing Zhu

In general class-incremental learning, researchers typically use sample sets as a tool to avoid catastrophic forgetting during continuous learning. At the same time, researchers have also noted the differences between class-incremental…

Machine Learning · Computer Science 2024-08-16 Weimin Yin , Bin Chen adn Chunzhao Xie , Zhenhao Tan

The advent of hyper-scale and general-purpose pre-trained models is shifting the paradigm of building task-specific models for target tasks. In the field of audio research, task-agnostic pre-trained models with high transferability and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-03 Ju-ho Kim , Jungwoo Heo , Hyun-seo Shin , Chan-yeong Lim , Ha-Jin Yu

We propose an algorithm for incremental learning of classifiers. The proposed method enables an ensemble of classifiers to learn incrementally by accommodating new training data. We use an effective mechanism to overcome the…

Machine Learning · Computer Science 2019-02-11 Shivang Agarwal , C. Ravindranath Chowdary , Shripriya Maheshwari