English
Related papers

Related papers: Dynamic Emotion and Personality Profiling for Mult…

200 papers

Traditional sentiment analysis has long been a unimodal task, relying solely on text. This approach overlooks non-verbal cues such as vocal tone and prosody that are essential for capturing true emotional intent. We introduce Dynamic…

Computation and Language · Computer Science 2025-09-30 Sadia Abdulhalim , Muaz Albaghdadi , Moshiur Farazi

Multimodal Sentiment Analysis (MSA) stands as a critical research frontier, seeking to comprehensively unravel human emotions by amalgamating text, audio, and visual data. Yet, discerning subtle emotional nuances within audio and video…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Sheng Wu , Xiaobao Wang , Longbiao Wang , Dongxiao He , Jianwu Dang

The purpose of emotion recognition in conversation (ERC) is to identify the emotion category of an utterance based on contextual information. Previous ERC methods relied on simple connections for cross-modal fusion and ignored the…

Computation and Language · Computer Science 2024-05-29 Haoxiang Shi , Xulong Zhang , Ning Cheng , Yong Zhang , Jun Yu , Jing Xiao , Jianzong Wang

Emotion recognition in conversations (ERC) is vital to the advancements of conversational AI and its applications. Therefore, the development of an automated ERC model using the concepts of machine learning (ML) would be beneficial.…

Computation and Language · Computer Science 2023-06-06 Amitabha Dey , Shan Suthaharan

Automatic emotion recognition plays a key role in computer-human interaction as it has the potential to enrich the next-generation artificial intelligence with emotional intelligence. It finds applications in customer and/or representative…

Sound · Computer Science 2022-02-21 Sarala Padi , Seyed Omid Sadjadi , Dinesh Manocha , Ram D. Sriram

Generating appropriate emotions for responses is essential for dialog systems to provide human-like interaction in various application scenarios. Most previous dialog systems tried to achieve this goal by learning empathetic manners from…

Computation and Language · Computer Science 2024-04-12 Zhiyuan Wen , Jiannong Cao , Jiaxing Shen , Ruosong Yang , Shuaiqi Liu , Maosong Sun

Multimodal sentiment analysis is a trending area of research, and the multimodal fusion is one of its most active topic. Acknowledging humans communicate through a variety of channels (i.e visual, acoustic, linguistic), multimodal systems…

Machine Learning · Computer Science 2021-09-10 Pierre Colombo , Emile Chapuis , Matthieu Labeau , Chloe Clavel

In this paper, a deep learning framework is proposed for automatic facial emotion based on deep convolutional networks. In order to increase the generalization ability and the robustness of the method, the dataset size is increased by…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Serap Kırbız

Multimodal emotion recognition is an important research topic in artificial intelligence, whose main goal is to integrate multimodal clues to identify human emotional states. Current works generally assume accurate labels for benchmark…

Emotion recognition is a complex task due to the inherent subjectivity in both the perception and production of emotions. The subjectivity of emotions poses significant challenges in developing accurate and robust computational models. This…

Machine Learning · Computer Science 2023-09-08 Mimansa Jaiswal

Emotion recognition is involved in several real-world applications. With an increase in available modalities, automatic understanding of emotions is being performed more accurately. The success in Multimodal Emotion Recognition (MER),…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Riccardo Franceschini , Enrico Fini , Cigdem Beyan , Alessandro Conti , Federica Arrigoni , Elisa Ricci

The emotion detection technology to enhance human decision-making is an important research issue for real-world applications, but real-life emotion datasets are relatively rare and small. The experiments conducted in this paper use the…

Computation and Language · Computer Science 2023-06-13 Théo Deschamps-Berger , Lori Lamel , Laurence Devillers

Dynamic facial expression recognition (DFER) is an important task in the field of computer vision. To apply automatic DFER in practice, it is necessary to accurately recognize ambiguous facial expressions, which often appear in data in the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Ryosuke Kawamura , Hideaki Hayashi , Noriko Takemura , Hajime Nagahara

Emotion recognition has the potential to play a pivotal role in enhancing human-computer interaction by enabling systems to accurately interpret and respond to human affect. Yet, capturing emotions in face-to-face contexts remains…

This paper proposes a multimodal emotion recognition system based on hybrid fusion that classifies the emotions depicted by speech utterances and corresponding images into discrete classes. A new interpretability technique has been…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Puneet Kumar , Sarthak Malik , Balasubramanian Raman

To enhance the performance of affective models and reduce the cost of acquiring physiological signals for real-world applications, we adopt multimodal deep learning approach to construct affective models from multiple physiological signals.…

Human-Computer Interaction · Computer Science 2016-02-29 Wei Liu , Wei-Long Zheng , Bao-Liang Lu

Depression is a severe mental disorder, and reliable identification plays a critical role in early intervention and treatment. Multimodal depression detection aims to improve diagnostic performance by jointly modeling complementary…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Chongxiao Wang , Junjie Liang , Peng Cao , Jinzhu Yang , Osmar R. Zaiane

Automatic depression detection has attracted increasing amount of attention but remains a challenging task. Psychological research suggests that depressive mood is closely related with emotion expression and perception, which motivates the…

Computation and Language · Computer Science 2022-11-18 Wen Wu , Mengyue Wu , Kai Yu

In this paper, we present empirical analysis on basic and depression specific multi-emotion mining in Tweets with the help of state of the art multi-label classifiers. We choose our basic emotions from a hybrid emotion model consisting of…

Machine Learning · Computer Science 2021-06-22 Nawshad Farruque , Chenyang Huang , Osmar Zaiane , Randy Goebel

Multimodal Emotion Recognition (MER) aims to accurately identify human emotional states by integrating heterogeneous modalities such as visual, auditory, and textual data. Existing approaches predominantly rely on unified emotion labels to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Wen Yin , Siyu Zhan , Cencen Liu , Xin Hu , Guiduo Duan , Xiurui Xie , Yuan-Fang Li , Tao He