English
Related papers

Related papers: Affect2MM: Affective Analysis of Multimedia Conten…

200 papers

Emotional coordination is a core property of human interaction that shapes how relational meaning is constructed in real time. While text-based affect inference has become increasingly feasible, prior approaches often treat sentiment as a…

Emotion recognition plays a pivotal role in enhancing human-computer interaction, particularly in movie recommendation systems where understanding emotional content is essential. While multimodal approaches combining audio and video have…

Sound · Computer Science 2025-11-25 Xiangrui Xiong , Zhou Zhou , Guocai Nong , Junlin Deng , Ning Wu

Small language models (SLM) are increasingly used as interactive decision-making agents, yet most decision-oriented evaluations ignore emotion as a causal factor influencing behavior. We study emotion-sensitive decision making by combining…

Artificial Intelligence · Computer Science 2026-04-09 Jiaju Lin , Xingjian Du , Qingyun Wu , Ellen Wenting Zou , Jindong Wang

Emotions, as a fundamental ingredient of any social interaction, lead to behaviors that represent the effectiveness of the interaction through facial expressions and gestures in humans. Hence an agent must possess the social and cognitive…

Computation and Language · Computer Science 2023-11-28 Muhammad Arslan Raza , Muhammad Shoaib Farooq , Adel Khelifi , Atif Alvi

Emotion recognition is the task of classifying perceived emotions in people. Previous works have utilized various nonverbal cues to extract features from images and correlate them to emotions. Of these cues, situational context is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Willams de Lima Costa , Estefania Talavera Martinez , Lucas Silva Figueiredo , Veronica Teichrieb

Computational modeling of the emotions evoked by art in humans is a challenging problem because of the subjective and nuanced nature of art and affective signals. In this paper, we consider the above-mentioned problem of understanding…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Digbalay Bose , Krishna Somandepalli , Souvik Kundu , Rimita Lahiri , Jonathan Gratch , Shrikanth Narayanan

In this paper, we present a model that can directly predict emotion intensity score from video inputs, instead of deriving from action units. Using a 3d DNN incorporated with dynamic emotion information, we train a model using videos of…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Jacob Ouyang , Isaac R Galatzer-Levy , Vidya Koesmahargyo , Li Zhang

Because multimodal data contains more modal information, multimodal sentiment analysis has become a recent research hotspot. However, redundant information is easily involved in feature fusion after feature extraction, which has a certain…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Huiru Wang , Xiuhong Li , Zenyu Ren , Dan Yang , chunming Ma

Throughout the past decade, many studies have classified human emotions using only a single sensing modality such as face video, electroencephalogram (EEG), electrocardiogram (ECG), galvanic skin response (GSR), etc. The results of these…

Human-Computer Interaction · Computer Science 2018-06-22 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Sentiment analysis aims to extract and express a person's perception, opinions and emotions towards an entity, object, product and a service, enabling businesses to obtain feedback from the consumers. The increasing popularity of the social…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Kashif Ahmad , Syed Zohaib , Nicola Conci , Ala Al-Fuqaha

In daily life, images as common affective stimuli have widespread applications. Despite significant progress in text-driven image editing, there is limited work focusing on understanding users' emotional requests. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Peixuan Zhang , Shuchen Weng , Chengxuan Zhu , Binghao Tang , Zijian Jia , Si Li , Boxin Shi

Emotion plays an essential role in human-to-human communication, enabling us to convey feelings such as happiness, frustration, and sincerity. While modern speech technologies rely heavily on speech recognition and natural language…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-05 Vasudha Kowtha , Vikramjit Mitra , Chris Bartels , Erik Marchi , Sue Booker , William Caruso , Sachin Kajarekar , Devang Naik

Video-based apparent affect detection plays a crucial role in video understanding, as it encompasses various elements such as vision, audio, audio-visual interactions, and spatiotemporal information, which are essential for accurate video…

Multimedia · Computer Science 2024-08-28 Mingwei Sun , Kunpeng Zhang

Due to its ability to accurately predict emotional state using multimodal features, audiovisual emotion recognition has recently gained more interest from researchers. This paper proposes two methods to predict emotional attributes from…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-22 Bagus Tris Atmaja , Masato Akagi

Technological advancement and its omnipresent connection have pushed humans past the boundaries and limitations of a computer screen, physical state, or geographical location. It has provided a depth of avenues that facilitate…

Multimedia · Computer Science 2023-11-21 Dayo Samuel Banjo , Connice Trimmingham , Niloofar Yousefi , Nitin Agarwal

Emotions widely affect human decision-making. This fact is taken into account by affective computing with the goal of tailoring decision support to the emotional states of individuals. However, the accurate recognition of emotions within…

Computation and Language · Computer Science 2018-11-14 Bernhard Kratzwald , Suzana Ilic , Mathias Kraus , Stefan Feuerriegel , Helmut Prendinger

In human interactions, emotion recognition is crucial. For this reason, the topic of computer-vision approaches for automatic emotion recognition is currently being extensively researched. Processing multi-channel electroencephalogram (EEG)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Joshua Bègue , Mohamed Aymen Labiod , Abdelhamid Melloulk

Advertisements (ads) often include strongly emotional content to leave a lasting impression on the viewer. This work (i) compiles an affective ad dataset capable of evoking coherent emotions across users, as determined from the affective…

Human-Computer Interaction · Computer Science 2017-09-07 Abhinav Shukla , Shruti Shriya Gullapuram , Harish Katti , Karthik Yadati , Mohan Kankanhalli , Ramanathan Subramanian

Sentiment Analysis (SA) or opinion mining is analysis of emotions and opinions from any kind of text. SA helps in tracking peoples viewpoints and it is an important factor when it comes to social media monitoring product and brand…

Computation and Language · Computer Science 2025-02-27 Gibson Nkhata , Usman Anjum , Justin Zhan

Sentiment analysis or opinion mining has become an open research domain after proliferation of Internet and Web 2.0 social media. People express their attitudes and opinions on social media including blogs, discussion forums, tweets, etc.…

Information Retrieval · Computer Science 2013-09-17 Anuj sharma , Shubhamoy Dey