中文
相关论文

相关论文: Multimodal Emotion Recognition from Raw Audio with…

200 篇论文

Time-continuous dimensional descriptions of emotions (e.g., arousal, valence) allow researchers to characterize short-time changes and to capture long-term trends in emotion expression. However, continuous emotion labels are generally not…

机器学习 · 计算机科学 2019-07-22 Soheil Khorram , Melvin G McInnis , Emily Mower Provost

Despite notable progress, speech emotion recognition (SER) remains challenging due to the intricate and ambiguous nature of speech emotion, particularly in wild world. While current studies primarily focus on recognition and generalization…

声音 · 计算机科学 2024-03-25 Yu Pan , Yuguang Yang , Yuheng Huang , Jixun Yao , Jingjing Yin , Yanni Hu , Heng Lu , Lei Ma , Jianjun Zhao

In recent years, speech emotion recognition (SER) has been used in wide ranging applications, from healthcare to the commercial sector. In addition to signal processing approaches, methods for SER now also use deep learning techniques which…

音频与语音处理 · 电气工程与系统科学 2022-03-29 Sneha Das , Nicole Nadine Lønfeldt , Anne Katrine Pagsberg , Line H. Clemmensen

Speech emotion recognition (SER) is a pivotal technology for human-computer interaction systems. However, 80.77% of SER papers yield results that cannot be reproduced. We develop EMO-SUPERB, short for EMOtion Speech Universal PERformance…

音频与语音处理 · 电气工程与系统科学 2024-03-13 Haibin Wu , Huang-Cheng Chou , Kai-Wei Chang , Lucas Goncalves , Jiawei Du , Jyh-Shing Roger Jang , Chi-Chun Lee , Hung-Yi Lee

This paper introduces scattering transform for speech emotion recognition (SER). Scattering transform generates feature representations which remain stable to deformations and shifting in time and frequency without much loss of information.…

音频与语音处理 · 电气工程与系统科学 2021-05-12 Premjeet Singh , Goutam Saha , Md Sahidullah

Speech Emotion Recognition (SER) is essential for improving human-computer interaction, yet its accuracy remains constrained by the complexity of emotional nuances in speech. In this study, we distinguish between descriptive semantics,…

计算与语言 · 计算机科学 2025-10-06 Rongchen Guo , Vincent Francoeur , Isar Nejadgholi , Sylvain Gagnon , Miodrag Bolic

Affective computing is a field of study that focuses on developing systems and technologies that can understand, interpret, and respond to human emotions. Speech Emotion Recognition (SER), in particular, has got a lot of attention from…

计算与语言 · 计算机科学 2023-12-20 Varun Sharma

The performance of speech emotion recognition (SER) is limited by the insufficient emotion information in unimodal systems and the feature alignment difficulties in multimodal systems. Recently, multimodal large language models (MLLMs) have…

声音 · 计算机科学 2025-09-22 Yiqing Yang , Man-Wai Mak

Emotion recognition (ER) from speech signals is a robust approach since it cannot be imitated like facial expression or text based sentiment analysis. Valuable information underlying the emotions are significant for human-computer…

声音 · 计算机科学 2023-12-19 David Hason Rudd , Huan Huo , Guandong Xu

There is an imminent need for guidelines and standard test sets to allow direct and fair comparisons of speech emotion recognition (SER). While resources, such as the Interactive Emotional Dyadic Motion Capture (IEMOCAP) database, have…

Despite the recent progress in speech emotion recognition (SER), state-of-the-art systems are unable to achieve improved performance in cross-language settings. In this paper, we propose a Multimodal Dual Attention Transformer (MDAT) model…

计算与语言 · 计算机科学 2023-07-17 Syed Aun Muhammad Zaidi , Siddique Latif , Junaid Qadir

Speech Emotion Recognition (SER) is a challenging task due to limited data and blurred boundaries of certain emotions. In this paper, we present a comprehensive approach to improve the SER performance throughout the model lifecycle,…

音频与语音处理 · 电气工程与系统科学 2023-09-01 Xuechen Wang , Shiwan Zhao , Yong Qin

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Speech Emotion Recognition (SER) task has known significant improvements over the last years with the advent of Deep Neural Networks (DNNs). However, even the most successful methods are still rather failing when adaptation to specific…

音频与语音处理 · 电气工程与系统科学 2021-04-16 Clément Le Moine , Nicolas Obin , Axel Roebel

EEG is a non-invasive, safe, and low-risk method to record electrophysiological signals inside the brain. Especially with recent technology developments like dry electrodes, consumer-grade EEG devices, and rapid advances in machine…

机器学习 · 计算机科学 2025-06-23 Tri Duc Ly , Gia H. Ngo

Multi-modal conversation emotion recognition (MCER) aims to recognize and track the speaker's emotional state using text, speech, and visual information in the conversation scene. Analyzing and studying MCER issues is significant to…

人工智能 · 计算机科学 2025-11-14 Yuntao Shou , Tao Meng , Wei Ai , Fangze Fu , Nan Yin , Keqin Li

Multimodal speech emotion recognition (SER) has emerged as pivotal for improving human-machine interaction. Researchers are increasingly leveraging both speech and textual information obtained through automatic speech recognition (ASR) to…

人机交互 · 计算机科学 2025-09-24 Jiajun He , Xiaohan Shi , Cheng-Hung Hu , Jinyi Mi , Xingfeng Li , Tomoki Toda

In this contribution, we investigate the effectiveness of deep fusion of text and audio features for categorical and dimensional speech emotion recognition (SER). We propose a novel, multistage fusion method where the two information…

机器学习 · 计算机科学 2023-03-27 Andreas Triantafyllopoulos , Uwe Reichel , Shuo Liu , Stephan Huber , Florian Eyben , Björn W. Schuller

Convolutional Neural Networks(CNNs) has achieved remarkable performance breakthrough in a variety of tasks. Recently, CNNs based methods that are fed with hand-extracted EEG features gradually produce a powerful performance on the EEG data…

信号处理 · 电气工程与系统科学 2021-05-31 Jingzhao Hu , Chen Wang , Qiaomei Jia , Qirong Bu , Jun Feng

Speech emotion recognition (SER) remains a challenging yet crucial task due to the inherent complexity and diversity of human emotions. To address this problem, researchers attempt to fuse information from other modalities via multimodal…

声音 · 计算机科学 2024-12-10 Feng Li , Jiusong Luo , Wanjun Xia