English
Related papers

Related papers: Semi-supervised cross-lingual speech emotion recog…

200 papers

As an effective way to alleviate the burden of data annotation, semi-supervised learning (SSL) provides an attractive solution due to its ability to leverage both labeled and unlabeled data to build a predictive model. While significant…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hai-Ming Xu , Lingqiao Liu , Hao Chen , Ehsan Abbasnejad , Rafael Felix

Semi-supervised learning in automatic speech recognition (ASR) typically relies on pseudo-labeling, which often suffers from confirmation bias and error accumulation due to noisy supervision. To address this limitation, we propose ReHear, a…

Computation and Language · Computer Science 2026-02-24 Zefang Liu , Chenyang Zhu , Sangwoo Cho , Shi-Xiong Zhang

Affective computing is very important in the relationship between man and machine. In this paper, a system for speech emotion recognition (SER) based on speech signal is proposed, which uses new techniques in different stages of processing.…

Sound · Computer Science 2021-11-16 Fatemeh Daneshfar , Seyed Jahanshah Kabudian

Speech Emotion Recognition (SER) plays a pivotal role in enhancing human-computer interaction by enabling a deeper understanding of emotional states across a wide range of applications, contributing to more empathetic and effective…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-25 Amirali Soltani Tehrani , Niloufar Faridani , Ramin Toosi

We propose a novel transfer learning method for speech emotion recognition allowing us to obtain promising results when only few training data is available. With as low as 125 examples per emotion class, we were able to reach a higher…

Machine Learning · Computer Science 2020-11-12 Jonathan Boigne , Biman Liyanage , Ted Östrem

The amount of labeled data to train models for speech tasks is limited for most languages, however, the data scarcity is exacerbated for speech translation which requires labeled data covering two different languages. To address this issue,…

Computation and Language · Computer Science 2022-10-20 Changhan Wang , Hirofumi Inaguma , Peng-Jen Chen , Ilia Kulikov , Yun Tang , Wei-Ning Hsu , Michael Auli , Juan Pino

In large part due to their implicit semantic modeling, self-supervised learning (SSL) methods have significantly increased the performance of valence recognition in speech emotion recognition (SER) systems. Yet, their large size may often…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-20 Danilo de Oliveira , Navin Raj Prabhu , Timo Gerkmann

Recently, there has been a vast interest in self-supervised learning (SSL) where the model is pre-trained on large scale unlabeled data and then fine-tuned on a small labeled dataset. The common wisdom is that SSL helps resource-limited…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-13 Chengyi Wang , Yu Wu , Shujie Liu , Jinyu Li , Yao Qian , Kenichi Kumatani , Furu Wei

Semi-supervised learning (SSL) has attracted much attention since it reduces the expensive costs of collecting adequate well-labeled training data, especially for deep learning methods. However, traditional SSL is built upon an assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Lie Ju , Yicheng Wu , Wei Feng , Zhen Yu , Lin Wang , Zhuoting Zhu , Zongyuan Ge

Given a small set of labeled data and a large set of unlabeled data, semi-supervised learning (SSL) attempts to leverage the location of the unlabeled datapoints in order to create a better classifier than could be obtained from supervised…

Machine Learning · Computer Science 2022-05-25 Michael C. Burkhart , Kyle Shan

This paper proposes a personalization method for speech emotion recognition (SER) through in-context learning (ICL). Since the expression of emotions varies from person to person, speaker-specific adaptation is crucial for improving the SER…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-11 Mana Ihori , Taiga Yamane , Naotaka Kawata , Naoki Makishima , Tomohiro Tanaka , Satoshi Suzuki , Shota Orihashi , Ryo Masumura

Semi-supervised learning (SSL) aims to train a machine learning model using both labelled and unlabelled data. While the unlabelled data have been used in various ways to improve the prediction accuracy, the reason why unlabelled data could…

Machine Learning · Statistics 2025-10-28 Archer Moore , Heejung Shim , Jingge Zhu , Mingming Gong

The current success of deep neural networks (DNNs) in an increasingly broad range of tasks involving artificial intelligence strongly depends on the quality and quantity of labeled training data. In general, the scarcity of labeled data,…

Computation and Language · Computer Science 2018-11-21 Shun Kiyono , Jun Suzuki , Kentaro Inui

In recent years, self-supervised learning (SSL) has achieved tremendous success in various speech tasks due to its power to extract representations from massive unlabeled data. However, compared with tasks such as speech recognition (ASR),…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-14 Tianrui Wang , Xie Chen , Zhuo Chen , Shu Yu , Weibin Zhu

While much of recent study in semi-supervised learning (SSL) has achieved strong performance on single-label classification problems, an equally important yet underexplored problem is how to leverage the advantage of unlabeled data in…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Junxiang Huang , Alexander Huang , Beatriz C. Guerra , Yen-Yun Yu

Self-supervised learning (SSL) models have achieved considerable improvements in automatic speech recognition (ASR). In addition, ASR performance could be further improved if the model is dedicated to audio content information learning…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-08 Genshun Wan , Tan Liu , Hang Chen , Jia Pan , Cong Liu , Zhongfu Ye

Speech Emotion Recognition (SER) presents a significant yet persistent challenge in human-computer interaction. While deep learning has advanced spoken language processing, achieving high performance on limited datasets remains a critical…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Tai Vu

Emotion recognition in conversations (ERC) is challenging due to the multimodal nature of the emotion expression. In this paper, we propose to pretrain a text-based recognition model from unsupervised speech transcripts with LLM guidance.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Soumya Dutta , Sriram Ganapathy

Semi-supervised learning (SSL) is a widely used technique in scenarios where labeled data is scarce and unlabeled data is abundant. While SSL is popular for image and text classification, it is relatively underexplored for the task of…

Computation and Language · Computer Science 2024-07-03 Gaurav Sahu , Olga Vechtomova , Issam H. Laradji

Cross-lingual adaptation, a special case of domain adaptation, refers to the transfer of classification knowledge between two languages. In this article we describe an extension of Structural Correspondence Learning (SCL), a recently…

Information Retrieval · Computer Science 2010-08-26 Peter Prettenhofer , Benno Stein