English
Related papers

Related papers: SeQuiFi: Mitigating Catastrophic Forgetting in Spe…

200 papers

Continually adapting edge models in cloud-edge collaborative object detection for traffic monitoring suffers from catastrophic forgetting, where models lose previously learned knowledge when adapting to new data distributions. This is…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Xinrun Xu , Jianwen Yang , Qiuhong Zhang , Zhanbiao Lian , Zhiming Ding , Shan Jiang

Transfer learning has been widely used in natural language processing through deep pretrained language models, such as Bidirectional Encoder Representations from Transformers and Universal Sentence Encoder. Despite the great success,…

Information Retrieval · Computer Science 2022-06-15 Maryam Hasan , Elke Rundensteiner , Emmanuel Agu

Continual learning (CL) is crucial for language models to dynamically adapt to the evolving real-world demands. To mitigate the catastrophic forgetting problem in CL, data replay has been proven a simple and effective strategy, and the…

Computation and Language · Computer Science 2024-11-12 Jinghan He , Haiyun Guo , Kuan Zhu , Zihan Zhao , Ming Tang , Jinqiao Wang

Speech Emotion Recognition (SER) plays a key role in advancing human-computer interaction. Attention mechanisms have become the dominant approach for modeling emotional speech due to their ability to capture long-range dependencies and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-17 Marc Casals-Salvador , Federico Costa , Rodolfo Zevallos , Javier Hernando

Amortized Bayesian Inference (ABI) enables efficient posterior estimation using generative neural networks trained on simulated data, but often suffers from performance degradation under model misspecification. While self-consistency (SC)…

Machine Learning · Statistics 2026-02-27 Aayush Mishra , Šimon Kucharský , Paul-Christian Bürkner

Continual Learning in semantic scene segmentation aims to continually learn new unseen classes in dynamic environments while maintaining previously learned knowledge. Prior studies focused on modeling the catastrophic forgetting and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Thanh-Dat Truong , Utsav Prabhu , Bhiksha Raj , Jackson Cothren , Khoa Luu

In this work, we detail our submission to the 2024 edition of the MSP-Podcast Speech Emotion Recognition (SER) Challenge. This challenge is divided into two distinct tasks: Categorical Emotion Recognition and Emotional Attribute Prediction.…

Artificial Intelligence · Computer Science 2024-07-09 Jarod Duret , Mickael Rouvier , Yannick Estève

Federated Learning has been introduced as a new machine learning paradigm enhancing the use of local devices. At a server level, FL regularly aggregates models learned locally on distributed clients to obtain a more general model. Current…

Machine Learning · Computer Science 2022-07-19 Anastasiia Usmanova , François Portet , Philippe Lalanda , German Vega

Prior works on speech emotion recognition utilize various unsupervised learning approaches to deal with low-resource samples. However, these methods pay less attention to modeling the long-term dynamic dependency, which is important for…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-31 Zheng Lian , Jianhua Tao , Bin Liu , Jian Huang

Class-incremental continual learning is an important area of research, as static deep learning methods fail to adapt to changing tasks and data distributions. In previous works, promising results were achieved using replay and compressed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Markus Weißflog , Peter Protzel , Peer Neubert

Catastrophic forgetting (CF) occurs when a neural network loses the information previously learned while training on a set of samples from a different distribution, i.e., a new task. Existing approaches have achieved remarkable results in…

Machine Learning · Computer Science 2022-09-13 Jary Pomponi , Simone Scardapane , Aurelio Uncini

Speech emotion recognition (SER) classifies audio into emotion categories such as Happy, Angry, Fear, Disgust and Neutral. While Speech Emotion Recognition (SER) is a common application for popular languages, it continues to be a problem…

Sound · Computer Science 2022-11-17 Zihan Wang , Qi Meng , HaiFeng Lan , XinRui Zhang , KeHao Guo , Akshat Gupta

Recent studies suggest that Reinforcement Fine-Tuning (RFT) is inherently more resilient to catastrophic forgetting than Supervised Fine-Tuning (SFT). However, whether RFT (e.g., GRPO) can effectively overcome forgetting in challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Meng Lou , Hanzhong Guo , Linwei Chen , Yizhou Yu

This work analyzes the constant-Q filterbank-based time-frequency representations for speech emotion recognition (SER). Constant-Q filterbank provides non-linear spectro-temporal representation with higher frequency resolution at low…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-30 Premjeet Singh , Shefali Waldekar , Md Sahidullah , Goutam Saha

Speech Emotion Recognition (SER) plays a crucial role in advancing human-computer interaction and speech processing capabilities. We introduce a novel deep-learning architecture designed specifically for the functional data model known as…

Sound · Computer Science 2024-03-27 Matthieu Saumard , Abir El Haj , Thibault Napoleon

Speech Emotion Recognition (SER) task has known significant improvements over the last years with the advent of Deep Neural Networks (DNNs). However, even the most successful methods are still rather failing when adaptation to specific…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-16 Clément Le Moine , Nicolas Obin , Axel Roebel

With the explosive growth of data, continual learning capability is increasingly important for neural networks. Due to catastrophic forgetting, neural networks inevitably forget the knowledge of old tasks after learning new ones. In visual…

Machine Learning · Computer Science 2024-02-26 Shengyang Huang , Jianwen Mo

Deep reinforcement learning has emerged as a powerful tool for a variety of learning tasks, however deep nets typically exhibit forgetting when learning multiple tasks in sequence. To mitigate forgetting, we propose an experience replay…

Artificial Intelligence · Computer Science 2018-03-01 David Isele , Akansel Cosgun

Discrete speech tokens offer significant advantages for storage and language model integration, but their application in speech emotion recognition (SER) is limited by paralinguistic information loss during quantization. This paper presents…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-27 Esther Sun , Abinay Reddy Naini , Carlos Busso

We propose a novel transfer learning method for speech emotion recognition allowing us to obtain promising results when only few training data is available. With as low as 125 examples per emotion class, we were able to reach a higher…

Machine Learning · Computer Science 2020-11-12 Jonathan Boigne , Biman Liyanage , Ted Östrem