English
Related papers

Related papers: Emotion estimation from video footage with LSTM

200 papers

Micro-expressions (MEs), brief and low-intensity facial movements revealing concealed emotions, are crucial for affective computing. Despite notable progress in ME recognition, existing methods are largely confined to discrete emotion…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Sirui Zhao , Zhengye Zhang , Shifeng Liu , Xinglong Mao , Shukang Yin , Chaoyou Fu , Tong Xu , Enhong Chen

This paper presents a novel approach to perform sentiment analysis of news videos, based on the fusion of audio, textual and visual clues extracted from their contents. The proposed approach aims at contributing to the semiodiscoursive…

Computation and Language · Computer Science 2016-04-12 Moisés H. R. Pereira , Flávio L. C. Pádua , Adriano C. M. Pereira , Fabrício Benevenuto , Daniel H. Dalip

Detection of human emotions based on facial images in real-world scenarios is a difficult task due to low image quality, variations in lighting, pose changes, background distractions, small inter-class variations, noisy crowd-sourced…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Sahil Naik , Soham Bagayatkar , Pavankumar Singh

Electromyography is an unexplored field of study when it comes to alternate input modality while interacting with a computer. However, to make computers understand human emotions is pivotal in the area of human-computer interaction and in…

Human-Computer Interaction · Computer Science 2019-11-14 Muhammad Shihab Rashid , Zubayet Zaman , Hasan Mahmud , Md. Kamrul Hasan

In this paper, we propose a sentiment-enriched lightweight network SeLiNet and an end-to-end on-device pipeline for contextual emotion recognition in images. SeLiNet model consists of body feature extractor, image aesthetics feature…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Tuneer Khargonkar , Shwetank Choudhary , Sumit Kumar , Barath Raj KR

Accurate emotion recognition is pivotal for nuanced and engaging human-computer interactions, yet remains difficult to achieve, especially in dynamic, conversation-like settings. In this study, we showcase how integrating eye-tracking data,…

Human-Computer Interaction · Computer Science 2025-11-03 Meisam Jamshidi Seikavandi , Jostein Fimland , Maria Barrett , Paolo Burelli

This paper introduces a multi-label visual emotion analysis benchmark dataset for comprehensively evaluating the ability of multimodal large language models (MLLMs) to predict the emotions evoked by images. Recent user studies report an…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Tianwei Chen , Takuya Furusawa , Yuki Hirakawa , Ryotaro Shimizu , Mo Fan , Takashi Wada

Understanding the mental state of other people is an important skill for intelligent agents and robots to operate within social environments. However, the mental processes involved in `mind-reading' are complex. One explanation of such…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Jonathan Vitale , Mary-Anne Williams , Benjamin Johnston , Giuseppe Boccignone

Text is the major method that is used for communication now a days, each and every day lots of text are created. In this paper the text data is used for the classification of the emotions. Emotions are the way of expression of the persons…

Computation and Language · Computer Science 2019-01-11 Naveenkumar K S , Vinayakumar R , Soman KP

Fine-grained emotion classification, which identifies specific emotional states such as happiness, anger, sadness, and fear, remains a challenging task in natural language processing. This study benchmarks classical machine learning and…

Movie story analysis requires understanding characters' emotions and mental states. Towards this goal, we formulate emotion understanding as predicting a diverse and multi-label set of emotions at the level of a movie scene and for each…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Dhruv Srivastava , Aditya Kumar Singh , Makarand Tapaswi

Understanding the facial expressions of our interlocutor is important to enrich the communication and to give it a depth that goes beyond the explicitly expressed. In fact, studying one's facial expression gives insight into their hidden…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Rim EL Cheikh , Hélène Tran , Issam Falih , Engelbert Mephu Nguifo

Recognizing faces and their underlying emotions is an important aspect of biometrics. In fact, estimating emotional states from faces has been tackled from several angles in the literature. In this paper, we follow the novel route of using…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Lorenzo Berlincioni , Luca Cultrera , Federico Becattini , Alberto Del Bimbo

Facial expression in-the-wild is essential for various interactive computing domains. Especially, "Learning from Synthetic Data" (LSD) is an important topic in the facial expression recognition task. In this paper, we propose a multi-task…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jae-Yeop Jeong , Yeong-Gi Hong , JiYeon Oh , Sumin Hong , Jin-Woo Jeong , Yuchul Jung

Emotion detection in older adults is crucial for understanding their cognitive and emotional well-being, especially in hospital and assisted living environments. In this work, we investigate an edge-based, non-obtrusive approach to emotion…

Human-Computer Interaction · Computer Science 2025-07-14 Md. Saif Hassan Onim , Andrew M. Kiselica , Himanshu Thapliyal

Introduction: Music provides an incredible avenue for individuals to express their thoughts and emotions, while also serving as a delightful mode of entertainment for enthusiasts and music lovers. Objectives: This paper presents a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Rajesh B , Keerthana V , Narayana Darapaneni , Anwesh Reddy P

Accomplishments in the field of artificial intelligence are utilized in the advancement of computing and making of intelligent machines for facilitating mankind and improving user experience. Emotions are rudimentary for people, affecting…

Sound · Computer Science 2022-06-22 Asfand Ali , Danial Nasir , Mohammad Hassan Jawad

Facial emotion recognition is the task to classify human emotions in face images. It is a difficult task due to high aleatoric uncertainty and visual ambiguity. A large part of the literature aims to show progress by increasing accuracy on…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Maryam Matin , Matias Valdenegro-Toro

Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sachihiro Youoku , Takahisa Yamamoto , Junya Saito , Akiyoshi Uchida , Xiaoyu Mi , Ziqiang Shi , Liu Liu , Zhongling Liu , Osafumi Nakayama , Kentaro Murase

Facial Emotion Recognition (FER) plays a crucial role in computer vision, with significant applications in human-computer interaction, affective computing, and areas such as mental health monitoring and personalized learning environments.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Arnab Kumar Roy , Hemant Kumar Kathania , Adhitiya Sharma