English
Related papers

Related papers: Multi-Modal Emotion Recognition for Enhanced Requi…

200 papers

Software engineering (SE) requires developers to collaborate with stakeholders, and understanding their emotions and perspectives is often vital. Empathy is a concept characterising a person's ability to understand and share the feelings of…

Software Engineering · Computer Science 2024-01-18 Hashini Gunatilake , John Grundy , Rashina Hoda , Ingo Mueller

This paper presents a Multi-modal Emotion Recognition (MER) system designed to enhance emotion recognition accuracy in challenging acoustic conditions. Our approach combines a modified and extended Hierarchical Token-semantic Audio…

Sound · Computer Science 2025-07-30 Ohad Cohen , Gershon Hazan , Sharon Gannot

Emotion Recognition (ER) is the process of analyzing and identifying human emotions from sensing data. Currently, the field heavily relies on facial expression recognition (FER) because visual channel conveys rich emotional cues. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Kejun Liu , Yuanyuan Liu , Lin Wei , Chang Tang , Yibing Zhan , Zijing Chen , Zhe Chen

Acceptance criteria (ACs) play a critical role in software development by clearly defining the conditions under which a software feature satisfies stakeholder expectations. However, manually creating accurate, comprehensive, and unambiguous…

Software Engineering · Computer Science 2025-08-12 Fanyu Wang , Chetan Arora , Yonghui Liu , Kaicheng Huang , Chakkrit Tantithamthavorn , Aldeida Aleti , Dishan Sambathkumar , David Lo

Emotion Recognition in Conversation (ERC) is a crucial task for understanding human emotions and enabling natural human-computer interaction. Although Large Language Models (LLMs) have recently shown great potential in this field, their…

Artificial Intelligence · Computer Science 2026-04-14 Xinran Li , Yu Liu , Jiaqi Qiao , Xiujuan Xu

Multimodal emotion recognition (MER) aims to detect the emotional status of a given expression by combining the speech and text information. Intuitively, label information should be capable of helping the model locate the salient…

Computation and Language · Computer Science 2023-09-06 Peiying Wang , Sunlu Zeng , Junqing Chen , Lu Fan , Meng Chen , Youzheng Wu , Xiaodong He

Multimodal Emotion Recognition (MER) focuses on identifying and interpreting emotions from modality-compound inputs. Closely mirroring human cognitive processes in real-world environments, MER has drawn substantial attention from both…

Multimedia · Computer Science 2026-05-21 Hongrui Zhang , Daiqing Wu , Yangyang Li , Kuien Liu , Yuhui Wang , Yu Zhou , Sicheng Zhao

Emotion recognition based on Electroencephalography (EEG) has gained significant attention and diversified development in fields such as neural signal processing and affective computing. However, the unique brain anatomy of individuals…

Signal Processing · Electrical Eng. & Systems 2024-05-31 Yihang Dong , Xuhang Chen , Yanyan Shen , Michael Kwok-Po Ng , Tao Qian , Shuqiang Wang

Humans use a host of signals to infer the emotional state of others. In general, computer systems that leverage signals from multiple modalities will be more robust and accurate in the same task. We present a multimodal affect and context…

Human-Computer Interaction · Computer Science 2019-03-29 Daniel McDuff , Kael Rowan , Piali Choudhury , Jessica Wolk , ThuVan Pham , Mary Czerwinski

Automatic emotion recognition has recently gained significant attention due to the growing popularity of deep learning algorithms. One of the primary challenges in emotion recognition is effectively utilizing the various cues (modalities)…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Mijanur Palash , Bharat Bhargava

Multimodal emotion recognition plays a crucial role in enhancing user experience in human-computer interaction. Over the past few decades, researchers have proposed a series of algorithms and achieved impressive progress. Although each…

Human-Computer Interaction · Computer Science 2024-04-23 Zheng Lian , Licai Sun , Yong Ren , Hao Gu , Haiyang Sun , Lan Chen , Bin Liu , Jianhua Tao

The purpose of emotion recognition in conversation (ERC) is to identify the emotion category of an utterance based on contextual information. Previous ERC methods relied on simple connections for cross-modal fusion and ignored the…

Computation and Language · Computer Science 2024-05-29 Haoxiang Shi , Xulong Zhang , Ning Cheng , Yong Zhang , Jun Yu , Jing Xiao , Jianzong Wang

Multi-modal conversation emotion recognition (MCER) aims to recognize and track the speaker's emotional state using text, speech, and visual information in the conversation scene. Analyzing and studying MCER issues is significant to…

Artificial Intelligence · Computer Science 2025-11-14 Yuntao Shou , Tao Meng , Wei Ai , Fangze Fu , Nan Yin , Keqin Li

Requirement Engineering (RE) is the foundation of successful software development. In RE, the goal is to ensure that implemented systems satisfy stakeholder needs through rigorous requirements elicitation, validation, and evaluation…

Software Engineering · Computer Science 2025-10-07 Mateen Ahmed Abbasi , Petri Ihantola , Tommi Mikkonen , Niko Mäkitalo

Multimodal emotion recognition in conversation (ERC) has garnered growing attention from research communities in various fields. In this paper, we propose a Cross-modal Fusion Network with Emotion-Shift Awareness (CFN-ESA) for ERC. Extant…

Computation and Language · Computer Science 2024-04-16 Jiang Li , Xiaoping Wang , Yingjian Liu , Zhigang Zeng

In this work, we present a lightweight and privacy-preserving Multimodal Emotion Recognition (MER) framework designed for deployment on edge devices. To demonstrate framework's versatility, our implementation uses three modalities - speech,…

Artificial Intelligence · Computer Science 2026-02-11 Rémi Grzeczkowicz , Eric Soriano , Ali Janati , Miyu Zhang , Gerard Comas-Quiles , Victor Carballo Araruna , Aneesh Jonelagadda

Emotion Prediction in Conversation (EPC) aims to forecast the emotions of forthcoming utterances by utilizing preceding dialogues. Previous EPC approaches relied on simple context modeling for emotion extraction, overlooking fine-grained…

Multimedia · Computer Science 2024-08-09 Haoxiang Shi , Ziqi Liang , Jun Yu

Explainable Multimodal Emotion Recognition plays a crucial role in applications such as human-computer interaction and social media analytics. However, current approaches struggle with cue-level perception and reasoning due to two main…

Multimedia · Computer Science 2026-02-06 Hanwen Zhang , Yao Liu , Peiyuan Jiang , Lang Junjie , Xie Jun , Yihui He , Yajiao Deng , Siyu Du , Qiao Liu

Stakeholders' conversations in requirements elicitation meetings hold valuable insights into system and client needs. However, manually extracting requirements is time-consuming, labor-intensive, and prone to errors and biases. While…

Software Engineering · Computer Science 2025-05-20 Gianmario Voria , Francesco Casillo , Carmine Gravino , Gemma Catolino , Fabio Palomba

Conversational recommender systems (CRSs) are able to elicit user preferences through multi-turn dialogues. They typically incorporate external knowledge and pre-trained language models to capture the dialogue context. Most CRS approaches,…

Information Retrieval · Computer Science 2024-09-18 Xiaoyu Zhang , Ruobing Xie , Yougang Lyu , Xin Xin , Pengjie Ren , Mingfei Liang , Bo Zhang , Zhanhui Kang , Maarten de Rijke , Zhaochun Ren