中文
相关论文

相关论文: Gems: Group Emotion Profiling Through Multimodal S…

200 篇论文

A graph neural network (GNN) for image understanding based on multiple cues is proposed in this paper. Compared to traditional feature and decision fusion approaches that neglect the fact that features can interact and exchange information,…

计算机视觉与模式识别 · 计算机科学 2020-03-02 Xin Guo , Luisa F. Polania , Bin Zhu , Charles Boncelet , Kenneth E. Barner

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

计算与语言 · 计算机科学 2025-05-09 Nischal Mandal , Yang Li

This paper describes the approach to the Emotion Classification shared task held at WASSA 2022 by team PVGs AI Club. This Track 2 sub-task focuses on building models which can predict a multi-class emotion label based on essays from news…

计算与语言 · 计算机科学 2022-05-03 Shaily Desai , Atharva Kshirsagar , Aditi Sidnerlikar , Nikhil Khodake , Manisha Marathe

Human emotion synthesis is a crucial aspect of affective computing. It involves using computational methods to mimic and convey human emotions through various modalities, with the goal of enabling more natural and effective human-computer…

机器学习 · 计算机科学 2024-12-11 Fei Ma , Yukan Li , Yifan Xie , Ying He , Yi Zhang , Hongwei Ren , Zhou Liu , Wei Yao , Fuji Ren , Fei Richard Yu , Shiguang Ni

Accurate emotion recognition is pivotal for nuanced and engaging human-computer interactions, yet remains difficult to achieve, especially in dynamic, conversation-like settings. In this study, we showcase how integrating eye-tracking data,…

人机交互 · 计算机科学 2025-11-03 Meisam Jamshidi Seikavandi , Jostein Fimland , Maria Barrett , Paolo Burelli

Applications based on image retrieval require editing and associating in intermediate spaces that are representative of the high-level concepts like objects and their relationships rather than dense, pixel-level representations like RGB…

计算机视觉与模式识别 · 计算机科学 2022-07-11 Rishi Agarwal , Tirupati Saketh Chandra , Vaidehi Patil , Aniruddha Mahapatra , Kuldeep Kulkarni , Vishwa Vinay

In the field of affective computing, researchers in the community have promoted the performance of models and algorithms by using the complementarity of multimodal information. However, the emergence of more and more modal information makes…

计算机视觉与模式识别 · 计算机科学 2023-05-01 Binqiang Wang , Gang Dong , Yaqian Zhao , Rengang Li , Lu Cao , Lihua Lu

Multimodal Emotion Recognition (MER) focuses on identifying and interpreting emotions from modality-compound inputs. Closely mirroring human cognitive processes in real-world environments, MER has drawn substantial attention from both…

多媒体 · 计算机科学 2026-05-21 Hongrui Zhang , Daiqing Wu , Yangyang Li , Kuien Liu , Yuhui Wang , Yu Zhou , Sicheng Zhao

Recognising emotions in context involves identifying an individual's apparent emotions while considering contextual cues from the surrounding scene. Previous approaches to this task have typically designed explicit scene-encoding…

计算机视觉与模式识别 · 计算机科学 2025-07-16 Alexandros Xenos , Niki Maria Foteinopoulou , Ioanna Ntinou , Ioannis Patras , Georgios Tzimiropoulos

The cohesiveness of a group is an essential indicator of the emotional state, structure and success of a group of people. We study the factors that influence the perception of group-level cohesion and propose methods for estimating the…

计算机视觉与模式识别 · 计算机科学 2019-04-09 Shreya Ghosh , Abhinav Dhall , Nicu Sebe , Tom Gedeon

Recent advancements in EEG-based emotion recognition have shown promising outcomes using both deep learning and classical machine learning approaches; however, most existing studies focus narrowly on binary valence prediction or…

机器学习 · 计算机科学 2025-09-01 Abdul Rehman , Ilona Heldal , Jerry Chun-Wei Lin

The interpretation of human voices holds importance across various applications. This study ventures into predicting age, gender, and emotion from vocal cues, a field with vast applications. Voice analysis tech advancements span domains,…

音频与语音处理 · 电气工程与系统科学 2024-03-05 Aron R , Indra Sigicharla , Chirag Periwal , Mohanaprasad K , Nithya Darisini P S , Sourabh Tiwari , Shivani Arora

Understanding human emotions from multimodal signals poses a significant challenge in affective computing and human-robot interaction. While multimodal large language models (MLLMs) have excelled in general vision-language tasks, their…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Xiaojiang Peng , Jingyi Chen , Zebang Cheng , Bao Peng , Fengyi Wu , Yifei Dong , Shuyuan Tu , Qiyu Hu , Huiting Huang , Yuxiang Lin , Jun-Yan He , Kai Wang , Zheng Lian , Zhi-Qi Cheng

Multimodal Emotion Recognition in Conversations remains a challenging task due to the complex interplay of textual, acoustic and visual signals. While recent models have improved performance via advanced fusion strategies, they often lack…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Guanyu Hu , Dimitrios Kollias , Xinyu Yang

Emotion recognition has the potential to play a pivotal role in enhancing human-computer interaction by enabling systems to accurately interpret and respond to human affect. Yet, capturing emotions in face-to-face contexts remains…

Emotion recognition from EEG signals is essential for affective computing and has been widely explored using deep learning. While recent deep learning approaches have achieved strong performance on single EEG emotion datasets, their…

机器学习 · 计算机科学 2025-11-17 Yuning Chen , Sha Zhao , Shijian Li , Gang Pan

Emotions are an inherent part of human interactions, and consequently, it is imperative to develop AI systems that understand and recognize human emotions. During a conversation involving various people, a person's emotions are influenced…

计算与语言 · 计算机科学 2022-05-06 Abhinav Joshi , Ashwani Bhat , Ayush Jain , Atin Vikram Singh , Ashutosh Modi

In the domain of human-computer interaction, accurately recognizing and interpreting human emotions is crucial yet challenging due to the complexity and subtlety of emotional expressions. This study explores the potential for detecting a…

多媒体 · 计算机科学 2025-05-13 Jiehui Jia , Huan Zhang , Jinhua Liang

Multimodal emotion recognition plays a crucial role in enhancing user experience in human-computer interaction. Over the past few decades, researchers have proposed a series of algorithms and achieved impressive progress. Although each…

人机交互 · 计算机科学 2024-04-23 Zheng Lian , Licai Sun , Yong Ren , Hao Gu , Haiyang Sun , Lan Chen , Bin Liu , Jianhua Tao

In this paper, we propose a new framework for fine-grained emotion prediction in the text through emotion definition modeling. Our approach involves a multi-task learning framework that models definitions of emotions as an auxiliary task…

计算与语言 · 计算机科学 2021-07-27 Gargi Singh , Dhanajit Brahma , Piyush Rai , Ashutosh Modi