English
Related papers

Related papers: Construction and Evaluation of Mandarin Multimodal…

200 papers

Accurate emotion perception is crucial for various applications, including human-computer interaction, education, and counseling. However, traditional single-modality approaches often fail to capture the complexity of real-world emotional…

Artificial Intelligence · Computer Science 2024-11-05 Zebang Cheng , Zhi-Qi Cheng , Jun-Yan He , Jingdong Sun , Kai Wang , Yuxiang Lin , Zheng Lian , Xiaojiang Peng , Alexander Hauptmann

Emotional text-to-speech (TTS) systems sturggle to capture the full spectrum of human emotions due to the inherent complexity of emotional expressions and the limited coverage of existing emotion labels. To address this, we propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-21 Kun Zhou , You Zhang , Dianwen Ng , Shengkui Zhao , Hao Wang , Bin Ma

Human emotions can be inferred from facial expressions. However, the annotations of facial expressions are often highly noisy in common emotion coding models, including categorical and dimensional ones. To reduce human labelling effort on…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Siwei Zhang , Zhiwu Huang , Danda Pani Paudel , Luc Van Gool

User satisfaction is closely related to enterprises, as it not only directly reflects users' subjective evaluation of service quality or products, but also affects customer loyalty and long-term business revenue. Monitoring and…

Computation and Language · Computer Science 2026-03-05 Jing Bian , Haoxiang Su , Liting Jiang , Di Wu , Ruiyu Fang , Xiaomeng Huang , Yanbing Li , Shuangyong Song , Hao Huang

Human beings have rich ways of emotional expressions, including facial action, voice, and natural languages. Due to the diversity and complexity of different individuals, the emotions expressed by various modalities may be semantically…

Artificial Intelligence · Computer Science 2023-02-06 Chuan Zhang , Daoxin Zhang , Ruixiu Zhang , Jiawei Li , Jianke Zhu

Affective computing plays a key role in human-computer interactions, entertainment, teaching, safe driving, and multimedia integration. Major breakthroughs have been made recently in the areas of affective computing (i.e., emotion…

Multimedia · Computer Science 2022-03-22 Yan Wang , Wei Song , Wei Tao , Antonio Liotta , Dawei Yang , Xinlei Li , Shuyong Gao , Yixuan Sun , Weifeng Ge , Wei Zhang , Wenqiang Zhang

Classical Chinese poetry is a vital and enduring part of Chinese literature, conveying profound emotional resonance. Existing studies analyze sentiment based on textual meanings, overlooking the unique rhythmic and visual features inherent…

Computation and Language · Computer Science 2025-05-20 Xiaocong Du , Haoyu Pei , Haipeng Zhang

This article describes a system for analyzing acoustic data to assist in the diagnosis and classification of children's speech sound disorders (SSDs) using a computer. The analysis concentrated on identifying and categorizing four distinct…

Sound · Computer Science 2022-07-07 Yao-Ming Kuo , Shanq-Jang Ruan , Yu-Chin Chen , Ya-Wen Tu

Vietnamese Speech Emotion Recognition (SER) remains challenging due to ambiguous acoustic patterns and the lack of reliable annotated data, especially in real-world conditions where emotional boundaries are not clearly separable. To address…

Computation and Language · Computer Science 2026-04-03 Truc Nguyen , Then Tran , Binh Truong , Phuoc Nguyen T. H

Despite recent advancements in speech emotion recognition (SER) models, state-of-the-art deep learning (DL) approaches face the challenge of the limited availability of annotated data. Large language models (LLMs) have revolutionised our…

Sound · Computer Science 2024-06-21 Siddique Latif , Muhammad Usama , Mohammad Ibrahim Malik , Björn W. Schuller

The long-standing goal of Artificial Intelligence (AI) has been to create human-like conversational systems. Such systems should have the ability to develop an emotional connection with the users, hence emotion recognition in dialogues is…

Computation and Language · Computer Science 2022-05-30 Gopendra Vikram Singh , Priyanshu Priya , Mauajama Firdaus , Asif Ekbal , Pushpak Bhattacharyya

Accurate speech emotion recognition is essential for developing human-facing systems. Recent advancements have included finetuning large, pretrained transformer models like Wav2Vec 2.0. However, the finetuning process requires substantial…

Sound · Computer Science 2025-03-07 Aneesha Sampath , James Tavernor , Emily Mower Provost

Emotional expressions form a key part of user behavior on today's digital platforms. While multimodal emotion recognition techniques are gaining research attention, there is a lack of deeper understanding on how visual and non-visual…

Multimedia · Computer Science 2021-07-01 Prasanta Bhattacharya , Raj Kumar Gupta , Yinping Yang

Emotion recognition or emotion prediction is a higher approach or a special case of sentiment analysis. In this task, the result is not produced in terms of either polarity: positive or negative or in the form of rating (from 1 to 5) but of…

Multimedia documents such as images, sounds or videos can be used to elicit emotional responses in exposed human subjects. These stimuli are stored in affective multimedia databases and successfully used for a wide variety of research in…

Multimedia · Computer Science 2014-01-14 Marko Horvat , Siniša Popović , Krešimir Ćosić

Our interpretation of value concepts is shaped by our sociocultural background and lived experiences, and is thus subjective. Recognizing individual value interpretations is important for developing AI systems that can align with diverse…

Computation and Language · Computer Science 2025-10-03 Adina Nicola Dobrinoiu , Ana Cristiana Marcu , Amir Homayounirad , Luciano Cavalcante Siebert , Enrico Liscio

Recognizing emotions during social interactions has many potential applications with the popularization of low-cost mobile sensors, but a challenge remains with the lack of naturalistic affective interaction data. Most existing emotion…

Human-Computer Interaction · Computer Science 2020-09-15 Cheul Young Park , Narae Cha , Soowon Kang , Auk Kim , Ahsan Habib Khandoker , Leontios Hadjileontiadis , Alice Oh , Yong Jeong , Uichin Lee

Recently, increasing attention has been directed to the study of the speech emotion recognition, in which global acoustic features of an utterance are mostly used to eliminate the content differences. However, the expression of speech…

Human-Computer Interaction · Computer Science 2018-11-21 Haotian Guan , Zhilei Liu , Longbiao Wang , Jianwu Dang , Ruiguo Yu

Robust speech emotion recognition relies on the quality of the speech features. We present speech features enhancement strategy that improves speech emotion recognition. We used the INTERSPEECH 2010 challenge feature-set. We identified…

Signal Processing · Electrical Eng. & Systems 2022-08-22 Sofia Kanwal , Sohail Asghar , Hazrat Ali

Speech Emotion Recognition systems often use static features like Mel-Frequency Cepstral Coefficients (MFCCs), Zero Crossing Rate (ZCR), and Root Mean Square Energy (RMSE). Because of this, they can misclassify emotions when there is…

Sound · Computer Science 2026-01-28 Marouane El Hizabri , Abdelfattah Bezzaz , Ismail Hayoukane , Youssef Taki