English
Related papers

Related papers: An Efficient Transfer Learning Method Based on Ada…

200 papers

Speech Emotion Recognition (SER) is a challenging task. In this paper, we introduce a modality conversion concept aimed at enhancing emotion recognition performance on the MELD dataset. We assess our approach through two experiments: first,…

Sound · Computer Science 2023-07-24 Zeinab Sadat Taghavi , Ali Satvaty , Hossein Sameti

When recognizing emotions from speech, we encounter two common problems: how to optimally capture emotion-relevant information from the speech signal and how to best quantify or categorize the noisy subjective emotion labels.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-04 Sofoklis Kakouros , Themos Stafylakis , Ladislav Mosner , Lukas Burget

The majority of existing speech emotion recognition research focuses on automatic emotion detection using training and testing data from same corpus collected under the same conditions. The performance of such systems has been shown to drop…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Siddique Latif , Rajib Rana , Shahzad Younis , Junaid Qadir , Julien Epps

While Wav2Vec 2.0 has been proposed for speech recognition (ASR), it can also be used for speech emotion recognition (SER); its performance can be significantly improved using different fine-tuning strategies. Two baseline methods, vanilla…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-22 Li-Wei Chen , Alexander Rudnicky

We introduce a self-supervised speech pre-training method called TERA, which stands for Transformer Encoder Representations from Alteration. Recent approaches often learn by using a single auxiliary task like contrastive prediction,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-05 Andy T. Liu , Shang-Wen Li , Hung-yi Lee

The computing power of mobile devices limits the end-user applications in terms of storage size, processing, memory and energy consumption. These limitations motivate researchers for the design of more efficient deep models. On the other…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-05 Pooyan Safari , Miquel India , Javier Hernando

Wav2vec2 has achieved success in applying Transformer architecture and self-supervised learning to speech recognition. Recently, these have come to be used not only for speech recognition but also for the entire speech processing. This…

Sound · Computer Science 2023-09-12 Harunori Kawano , Sota Shimizu

Prompting and adapter tuning have emerged as efficient alternatives to fine-tuning (FT) methods. However, existing studies on speech prompting focused on classification tasks and failed on more complex sequence generation tasks. Besides,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-16 Kai-Wei Chang , Ming-Hsin Chen , Yun-Ping Lin , Jing Neng Hsu , Paul Kuo-Ming Huang , Chien-yu Huang , Shang-Wen Li , Hung-yi Lee

End-to-end models are fast replacing the conventional hybrid models in automatic speech recognition. Transformer, a sequence-to-sequence model, based on self-attention popularly used in machine translation tasks, has given promising results…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-19 Vishwas M. Shetty , Metilda Sagaya Mary N J , S. Umesh

Adapters, a plug-in neural network module with some tunable parameters, have emerged as a parameter-efficient transfer learning technique for adapting pre-trained models to downstream tasks, especially for natural language processing (NLP)…

Information Retrieval · Computer Science 2023-12-11 Junchen Fu , Fajie Yuan , Yu Song , Zheng Yuan , Mingyue Cheng , Shenghui Cheng , Jiaqi Zhang , Jie Wang , Yunzhu Pan

Speech Emotion Recognition (SER) plays a crucial role in enhancing human-computer interaction. Cross-Linguistic SER (CLSER) has been a challenging research problem due to significant variability in linguistic and acoustic features of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Ruoyu Zhao , Xiantao Jiang , F. Richard Yu , Victor C. M. Leung , Tao Wang , Shaohu Zhang

In recent years, the rapid progress in speaker verification (SV) technology has been driven by the extraction of speaker representations based on deep learning. However, such representations are still vulnerable to emotion variability. To…

Sound · Computer Science 2025-05-27 Jingguang Tian , Xinhui Hu , Xinkang Xu

Speech emotion recognition (SER) models typically rely on costly human-labeled data for training, making scaling methods to large speech datasets and nuanced emotion taxonomies difficult. We present LanSER, a method that enables the use of…

Computation and Language · Computer Science 2023-09-11 Taesik Gong , Josh Belanich , Krishna Somandepalli , Arsha Nagrani , Brian Eoff , Brendan Jou

Cross-corpus speech emotion recognition (SER) poses a challenge due to feature distribution mismatch, potentially degrading the performance of established SER methods. In this paper, we tackle this challenge by proposing a novel transfer…

Sound · Computer Science 2023-12-12 Yan Zhao , Yuan Zong , Hailun Lian , Cheng Lu , Jingang Shi , Wenming Zheng

Transfer learning with large pretrained transformer-based language models like BERT has become a dominating approach for most NLP tasks. Simply fine-tuning those large language models on downstream tasks or combining it with task-specific…

Computation and Language · Computer Science 2021-08-06 Wenjuan Han , Bo Pang , Yingnian Wu

In this paper, we demonstrate the efficacy of transfer learning and continuous learning for various automatic speech recognition (ASR) tasks. We start with a pre-trained English ASR model and show that transfer learning can be effectively…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-12 Jocelyn Huang , Oleksii Kuchaiev , Patrick O'Neill , Vitaly Lavrukhin , Jason Li , Adriana Flores , Georg Kucsko , Boris Ginsburg

Speech Emotion Recognition (SER) presents a significant yet persistent challenge in human-computer interaction. While deep learning has advanced spoken language processing, achieving high performance on limited datasets remains a critical…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Tai Vu

The prediction of valence from speech is an important, but challenging problem. The externalization of valence in speech has speaker-dependent cues, which contribute to performances that are often significantly lower than the prediction of…

Sound · Computer Science 2023-05-15 Kusha Sridhar , Carlos Busso

Emotion detection in natural language processing is a challenging task due to the complexity of human emotions and linguistic diversity. While significant progress has been made in high-resource languages, emotion detection in low-resource…

Computation and Language · Computer Science 2025-04-14 Frances Laureano De Leon , Yixiao Wang , Yue Feng , Mark G. Lee

Transfer learning is an important approach for addressing the challenges posed by limited data availability in various applications. It accomplishes this by transferring knowledge from well-established source domains to a less familiar…

Machine Learning · Statistics 2025-03-03 Yeheng Ge , Xueyu Zhou , Jian Huang
‹ Prev 1 3 4 5 6 7 10 Next ›