English
Related papers

Related papers: Utilizing Speech Emotion Recognition and Recommend…

200 papers

Multimodal Emotion Recognition (MER) aims to automatically identify and understand human emotional states by integrating information from various modalities. However, the scarcity of annotated multimodal data significantly hinders the…

Human-Computer Interaction · Computer Science 2024-09-11 Zhixian Zhao , Haifeng Chen , Xi Li , Dongmei Jiang , Lei Xie

This research aims at identifying the unknown emotion using speaker cues. In this study, we identify the unknown emotion using a two-stage framework. The first stage focuses on identifying the speaker who uttered the unknown emotion, while…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-11 Ismail Shahin

Previous work on emotion recognition demonstrated a synergistic effect of combining several modalities such as auditory, visual, and transcribed text to estimate the affective state of a speaker. Among these, the linguistic modality is…

Computation and Language · Computer Science 2019-03-01 Egor Lakomkin , Mohammad Ali Zamani , Cornelius Weber , Sven Magg , Stefan Wermter

Emotion detection is a central problem in NLP, with recent progress driven by transformer-based models trained on established datasets. However, little is known about the linguistic regularities that characterize how emotions are expressed…

Computation and Language · Computer Science 2026-03-24 Florian Lecourt , Madalina Croitoru , Konstantin Todorov

In recent times, a large number of people have been involved in establishing their own businesses. Unlike humans, chatbots can serve multiple customers at a time, are available 24/7 and reply in less than a fraction of a second. Though…

Recognizing the patient's emotions using deep learning techniques has attracted significant attention recently due to technological advancements. Automatically identifying the emotions can help build smart healthcare centers that can detect…

Machine Learning · Computer Science 2021-07-14 Marwan Dhuheir , Abdullatif Albaseer , Emna Baccour , Aiman Erbad , Mohamed Abdallah , Mounir Hamdi

Speech emotion recognition (SER) has advanced significantly for the sake of deep-learning methods, while textual information further enhances its performance. However, few studies have focused on the physiological information during speech…

Sound · Computer Science 2025-11-12 Ziqian Zhang , Min Huang , Zhongzhe Xiao

In this work, we conduct an extensive comparison of various approaches to speech based emotion recognition systems. The analyses were carried out on audio recordings from Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS).…

Sound · Computer Science 2019-12-24 Kannan Venkataramanan , Haresh Rengaraj Rajamohan

Emotion is intrinsic to humans and consequently emotion understanding is a key part of human-like artificial intelligence (AI). Emotion recognition in conversation (ERC) is becoming increasingly popular as a new research frontier in natural…

Computation and Language · Computer Science 2019-05-09 Soujanya Poria , Navonil Majumder , Rada Mihalcea , Eduard Hovy

The majority of existing speech emotion recognition research focuses on automatic emotion detection using training and testing data from same corpus collected under the same conditions. The performance of such systems has been shown to drop…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Siddique Latif , Rajib Rana , Shahzad Younis , Junaid Qadir , Julien Epps

The mainstream paradigm of speech emotion recognition (SER) is identifying the single emotion label of the entire utterance. This line of works neglect the emotion dynamics at fine temporal granularity and mostly fail to leverage linguistic…

Sound · Computer Science 2024-03-29 Siyuan Shen , Yu Gao , Feng Liu , Hanyang Wang , Aimin Zhou

This paper introduces a large-scale, validated database for Persian called Sharif Emotional Speech Database (ShEMO). The database includes 3000 semi-natural utterances, equivalent to 3 hours and 25 minutes of speech data extracted from…

Computation and Language · Computer Science 2019-06-12 Omid Mohamad Nezami , Paria Jamshid Lou , Mansoureh Karami

The delivery of mental health interventions via ubiquitous devices has shown much promise. A conversational chatbot is a promising oracle for delivering appropriate just-in-time interventions. However, designing emotionally-aware agents,…

Human-Computer Interaction · Computer Science 2019-07-24 Asma Ghandeharioun , Daniel McDuff , Mary Czerwinski , Kael Rowan

Speech Emotion Recognition (SER) has become a growing focus of research in human-computer interaction. Spatiotemporal features play a crucial role in SER, yet current research lacks comprehensive spatiotemporal feature learning. This paper…

Sound · Computer Science 2023-12-29 Mengbo Li , Yuanzhong Zheng , Dichucheng Li , Yulun Wu , Yaoxuan Wang , Haojun Fei

Despite the recent progress in speech emotion recognition (SER), state-of-the-art systems are unable to achieve improved performance in cross-language settings. In this paper, we propose a Multimodal Dual Attention Transformer (MDAT) model…

Computation and Language · Computer Science 2023-07-17 Syed Aun Muhammad Zaidi , Siddique Latif , Junaid Qadir

Large Language Models (LLMs) have shown remarkable performance in Natural Language Processing tasks, including Machine Translation (MT). In this work, we propose a novel MT pipeline that integrates emotion information extracted from a…

Computation and Language · Computer Science 2024-08-07 Charles Brazier , Jean-Luc Rouas

Speech Emotion Recognition (SER) is essential for improving human-computer interaction, yet its accuracy remains constrained by the complexity of emotional nuances in speech. In this study, we distinguish between descriptive semantics,…

Computation and Language · Computer Science 2025-10-06 Rongchen Guo , Vincent Francoeur , Isar Nejadgholi , Sylvain Gagnon , Miodrag Bolic

Recognizing emotions in spoken communication is crucial for advanced human-machine interaction. Current emotion detection methodologies often display biases when applied cross-corpus. To address this, our study amalgamates 16 diverse…

Computation and Language · Computer Science 2023-11-16 Mohamed Osman , Tamer Nadeem , Ghada Khoriba

Speech emotion recognition (SER) has garnered increasing attention due to its wide range of applications in various fields, including human-machine interaction, virtual assistants, and mental health assistance. However, existing SER methods…

Sound · Computer Science 2024-05-02 Dongyuan Li , Ying Zhang , Yusong Wang , Funakoshi Kataro , Manabu Okumura

Emotion dynamics modeling is a significant task in emotion recognition in conversation. It aims to predict conversational emotions when building empathetic dialogue systems. Existing studies mainly develop models based on Recurrent Neural…

Artificial Intelligence · Computer Science 2021-04-22 Haiqin Yang , Jianping Shen