English
Related papers

Related papers: Improving Cross-Corpus Speech Emotion Recognition …

200 papers

Previous work on emotion recognition demonstrated a synergistic effect of combining several modalities such as auditory, visual, and transcribed text to estimate the affective state of a speaker. Among these, the linguistic modality is…

Computation and Language · Computer Science 2019-03-01 Egor Lakomkin , Mohammad Ali Zamani , Cornelius Weber , Sven Magg , Stefan Wermter

Electroencephalography (EEG) is shown to be a valuable data source for evaluating subjects' mental states. However, the interpretation of multi-modal EEG signals is challenging, as they suffer from poor signal-to-noise-ratio, are highly…

Signal Processing · Electrical Eng. & Systems 2022-04-19 David Bethge , Philipp Hallgarten , Ozan Özdenizci , Ralf Mikut , Albrecht Schmidt , Tobias Grosse-Puppendahl

Multimodal speech emotion recognition (SER) has emerged as pivotal for improving human-machine interaction. Researchers are increasingly leveraging both speech and textual information obtained through automatic speech recognition (ASR) to…

Human-Computer Interaction · Computer Science 2025-09-24 Jiajun He , Xiaohan Shi , Cheng-Hung Hu , Jinyi Mi , Xingfeng Li , Tomoki Toda

Adversarial discriminative domain adaptation (ADDA) is an efficient framework for unsupervised domain adaptation in image classification, where the source and target domains are assumed to have the same classes, but no labels are available…

Computer Vision and Pattern Recognition · Computer Science 2019-11-12 Aaron Chadha , Yiannis Andreopoulos

Domain-adapted sentiment classification refers to training on a labeled source domain to well infer document-level sentiment on an unlabeled target domain. Most existing relevant models involve a feature extractor and a sentiment…

Computation and Language · Computer Science 2020-02-06 Qianming Xue , Wei Zhang , Hongyuan Zha

Audio Deepfake Detection (ADD) aims to detect spoof speech from bonafide speech. Most prior studies assume that stronger correlations within or across acoustic and emotional features imply authenticity, and thus focus on enhancing or…

Sound · Computer Science 2026-01-21 Jinhua Zhang , Zhenqi Jia , Rui Liu

Convolutional neural networks have been widely applied to medical image segmentation and have achieved considerable performance. However, the performance may be significantly affected by the domain gap between training data (source domain)…

Image and Video Processing · Electrical Eng. & Systems 2022-07-28 Junyan Lyu , Yiqi Zhang , Yijin Huang , Li Lin , Pujin Cheng , Xiaoying Tang

Sentiment analysis is a costly yet necessary task for enterprises to study the opinions of their customers to improve their products and to determine optimal marketing strategies. Due to the existence of a wide range of domains across…

Computation and Language · Computer Science 2021-07-06 Mohammad Rostami , Aram Galstyan

Despite the recent progress in speech emotion recognition (SER), state-of-the-art systems lack generalisation across different conditions. A key underlying reason for poor generalisation is the scarcity of emotion datasets, which is a…

Sound · Computer Science 2022-07-13 Siddique Latif , Rajib Rana , Sara Khalifa , Raja Jurdak , Björn W. Schuller

Emotion and intent recognition from speech is essential and has been widely investigated in human-computer interaction. The rapid development of social media platforms, chatbots, and other technologies has led to a large volume of speech…

Sound · Computer Science 2025-07-11 Zhao Ren , Rathi Adarshi Rammohan , Kevin Scheck , Sheng Li , Tanja Schultz

While speech emotion recognition (SER) research has made significant progress, achieving generalization across various corpora continues to pose a problem. We propose a novel domain adaptation technique that embodies a multitask framework…

Computation and Language · Computer Science 2023-10-10 Chung-Soo Ahn , Jagath C. Rajapakse , Rajib Rana

Research on Speech Emotion Recognition (SER) often faces challenges such as the lack of large-scale public datasets and limited generalization capability when dealing with data from different distributions. To solve this problem, this paper…

Sound · Computer Science 2024-12-02 Xiang minjie

Non-speech emotion recognition has a wide range of applications including healthcare, crime control and rescue, and entertainment, to name a few. Providing these applications using edge computing has great potential, however, recent studies…

Sound · Computer Science 2023-05-02 Ibrahim Malik , Siddique Latif , Sanaullah Manzoor , Muhammad Usama , Junaid Qadir , Raja Jurdak

In recent years great success has been achieved in sentiment classification for English, thanks in part to the availability of copious annotated resources. Unfortunately, most languages do not enjoy such an abundance of labeled data. To…

Computation and Language · Computer Science 2018-08-21 Xilun Chen , Yu Sun , Ben Athiwaratkun , Claire Cardie , Kilian Weinberger

In this work, we present a novel perspective on cognitive impairment classification from speech by integrating speech foundation models that explicitly recognize speech dialects. Our motivation is based on the observation that individuals…

Sound · Computer Science 2026-01-14 Tiantian Feng , Anfeng Xu , Jinkook Lee , Shrikanth Narayanan

Electroencephalogram (EEG) signals serve as a powerful tool in affective Brain-Computer Interfaces (aBCIs) and play a crucial role in affective computing. In recent years, the introduction of deep learning techniques has significantly…

Machine Learning · Computer Science 2025-08-08 Guangli Li , Canbiao Wu , Zhehao Zhou , Tuo Sun , Ping Tan , Li Zhang , Zhen Liang

The purpose of emotion recognition in conversation (ERC) is to identify the emotion category of an utterance based on contextual information. Previous ERC methods relied on simple connections for cross-modal fusion and ignored the…

Computation and Language · Computer Science 2024-05-29 Haoxiang Shi , Xulong Zhang , Ning Cheng , Yong Zhang , Jun Yu , Jing Xiao , Jianzong Wang

Emotion plays a fundamental role in human interaction, and therefore systems capable of identifying emotions in speech are crucial in the context of human-computer interaction. Speech emotion recognition (SER) is a challenging problem,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Lucas Ueda , João Lima , Leonardo Marques , Paula Costa

This paper proposes a multimodal emotion recognition system based on hybrid fusion that classifies the emotions depicted by speech utterances and corresponding images into discrete classes. A new interpretability technique has been…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Puneet Kumar , Sarthak Malik , Balasubramanian Raman

Speech emotion sensing in communication networks has a wide range of applications in real life. In these applications, voice data are transmitted from the user to the central server for storage, processing, and decision making. However,…