English
Related papers

Related papers: Continual Learning For On-Device Environmental Sou…

200 papers

We tackle the problem of learning linear classifiers from noisy datasets in a multiclass setting. The two-class version of this problem was studied a few years ago where the proposed approaches to combat the noise revolve around a…

Machine Learning · Computer Science 2015-06-25 Ugo Louche , Liva Ralaivola

Learning a set of tasks over time, also known as continual learning (CL), is one of the most challenging problems in artificial intelligence due to catastrophic forgetting. Large language models (LLMs) are often impractical to frequent…

Machine Learning · Computer Science 2025-10-28 Jaya Krishna Mandivarapu

In continual learning, solving the catastrophic forgetting problem may make the models fall into the stability-plasticity dilemma. Moreover, inter-task confusion will also occur due to the lack of knowledge exchanges between different…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Sheng-Kai Huang , Jiun-Feng Chang , Chun-Rong Huang

The design of new methods and models when only weakly-labeled data are available is of paramount importance in order to reduce the costs of manual annotation and the considerable human effort associated with it. In this work, we address…

Sound · Computer Science 2019-04-02 Thomas Pellegrini , Léo Cances

Convolutional neural networks (CNN) are one of the best-performing neural network architectures for environmental sound classification (ESC). Recently, temporal attention mechanisms have been used in CNN to capture the useful information…

Sound · Computer Science 2020-05-22 Helin Wang , Yuexian Zou , Dading Chong , Wenwu Wang

Continual learning is the problem of learning new tasks or knowledge while protecting old knowledge and ideally generalizing from old experience to learn new tasks faster. Neural networks trained by stochastic gradient descent often degrade…

Machine Learning · Computer Science 2019-11-27 David Rolnick , Arun Ahuja , Jonathan Schwarz , Timothy P. Lillicrap , Greg Wayne

Deep learning architectures exhibit a critical drop of performance due to catastrophic forgetting when they are required to incrementally learn new tasks. Contemporary incremental learning frameworks focus on image classification and object…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Umberto Michieli , Pietro Zanuttigh

The intrinsic difficulty in adapting deep learning models to non-stationary environments limits the applicability of neural networks to real-world tasks. This issue is critical in practical supervised learning settings, such as the ones in…

Machine Learning · Computer Science 2023-06-09 Simone Marullo , Matteo Tiezzi , Marco Gori , Stefano Melacci , Tinne Tuytelaars

Given data with label noise (i.e., incorrect data), deep neural networks would gradually memorize the label noise and impair model performance. To relieve this issue, curriculum learning is proposed to improve model performance and…

Machine Learning · Computer Science 2022-08-23 Tingting Wu , Xiao Ding , Hao Zhang , Jinglong Gao , Li Du , Bing Qin , Ting Liu

Label noise is emerging as a pressing issue in sound event classification. This arises as we move towards larger datasets that are difficult to annotate manually, but it is even more severe if datasets are collected automatically from…

Sound · Computer Science 2019-10-29 Eduardo Fonseca , Frederic Font , Xavier Serra

A key challenge for machine intelligence is to learn new visual concepts without forgetting the previously acquired knowledge. Continual learning is aimed towards addressing this challenge. However, there is a gap between existing…

Machine Learning · Computer Science 2024-02-01 Yan Luo , Yongkang Wong , Mohan Kankanhalli , Qi Zhao

Urban sound classification has been achieving remarkable progress and is still an active research area in audio pattern recognition. In particular, it allows to monitor the noise pollution, which becomes a growing concern for large cities.…

Sound · Computer Science 2020-10-23 Augustin Arnault , Baptiste Hanssens , Nicolas Riche

To discover intrinsic inter-class transition probabilities underlying data, learning with noise transition has become an important approach for robust deep learning on corrupted labels. Prior methods attempt to achieve such transition…

Machine Learning · Computer Science 2020-06-15 Jun Shu , Qian Zhao , Zongben Xu , Deyu Meng

Continual learning poses a fundamental challenge for modern machine learning systems, requiring models to adapt to new tasks while retaining knowledge from previous ones. Addressing this challenge necessitates the development of efficient…

Machine Learning · Computer Science 2024-04-10 Jędrzej Kozal , Jan Wasilewski , Bartosz Krawczyk , Michał Woźniak

In learning tasks with label noise, improving model robustness against overfitting is a pivotal challenge because the model eventually memorizes labels, including the noisy ones. Identifying the samples with noisy labels and preventing the…

Machine Learning · Computer Science 2023-09-28 Reihaneh Torkzadehmahani , Reza Nasirigerdeh , Daniel Rueckert , Georgios Kaissis

In many real-world scenarios, data to train machine learning models become available over time. However, neural network models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon…

Machine Learning · Computer Science 2022-06-29 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

Continual learning tackles the setting of learning different tasks sequentially. Despite the lots of previous solutions, most of them still suffer significant forgetting or expensive memory cost. In this work, targeted at these problems, we…

Machine Learning · Computer Science 2022-03-17 Yujun Shi , Li Yuan , Yunpeng Chen , Jiashi Feng

Spectrum sensing is a key technology for cognitive radios. We present spectrum sensing as a classification problem and propose a sensing method based on deep learning classification. We normalize the received signal power to overcome the…

Signal Processing · Electrical Eng. & Systems 2019-09-16 Shilian Zheng , Shichuan Chen , Peihan Qi , Huaji Zhou , Xiaoniu Yang

Ensemble Learning methods combine multiple algorithms performing the same task to build a group with superior quality. These systems are well adapted to the distributed setup, where each peer or machine of the network hosts one algorithm…

Machine Learning · Computer Science 2021-10-19 Gaëlle Candel , David Naccache

Sound source localization (SSL) is essential for many speech-processing applications. Deep learning models have achieved high performance, but often fail when the training and inference environments differ. Adapting SSL models to dynamic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-21 Yang Xiao , Rohan Kumar Das