English
Related papers

Related papers: Context-Aware Academic Emotion Dataset and Benchma…

200 papers

In the context of education technology, empathic interaction with the user and feedback by the learning system using multiple inputs such as video, voice and text inputs is an important area of research. In this paper, a nonintrusive,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 S L Happy , A. Dasgupta , P. Patnaik , A. Routray

We present a demonstration of REACT, a new Real-time Educational AI-powered Classroom Tool that employs EDM techniques for supporting the decision-making process of educators. REACT is a data-driven tool with a user-friendly graphical…

Computers and Society · Computer Science 2021-08-18 Ajay Kulkarni , Olga Gkountouna

The Complex Emotion Recognition System (CERS) deciphers complex emotional states by examining combinations of basic emotions expressed, their interconnections, and the dynamic variations. Through the utilization of advanced algorithms, CERS…

Signal Processing · Electrical Eng. & Systems 2024-09-13 Javad Hassannataj Joloudari , Mohammad Maftoun , Bahareh Nakisa , Roohallah Alizadehsani , Meisam Yadollahzadeh-Tabari

Automatic emotion recognition for real-life appli-cations is a challenging task. Human emotion expressions aresubtle, and can be conveyed by a combination of several emo-tions. In most existing emotion recognition studies, each…

Sound · Computer Science 2022-03-08 Jay Desai , Houwei Cao , Ravi Shah

Explainable Multimodal Emotion Recognition (EMER) is an emerging task that aims to achieve reliable and accurate emotion recognition. However, due to the high annotation cost, the existing dataset (denoted as EMER-Fine) is small, making it…

Human-Computer Interaction · Computer Science 2024-07-11 Zheng Lian , Haiyang Sun , Licai Sun , Jiangyan Yi , Bin Liu , Jianhua Tao

Nowadays, short-form videos (SVs) are essential to web information acquisition and sharing in our daily life. The prevailing use of SVs to spread emotions leads to the necessity of conducting video emotion analysis (VEA) towards SVs.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xuecheng Wu , Heli Sun , Junxiao Xue , Jiayu Nie , Xiangyan Kong , Ruofan Zhai , Liang He

Current facial emotion recognition systems are predominately trained to predict a fixed set of predefined categories or abstract dimensional values. This constrained form of supervision hinders generalization and applicability, as it…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Licai Sun , Xingxun Jiang , Haoyu Chen , Yante Li , Zheng Lian , Biu Liu , Yuan Zong , Wenming Zheng , Jukka M. Leppänen , Guoying Zhao

Visual Emotion Analysis (VEA) aims at predicting people's emotional responses to visual stimuli. This is a promising, yet challenging, task in affective computing, which has drawn increasing attention in recent years. Most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Jingyuan Yang , Qirui Huang , Tingting Ding , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Multimodal emotion recognition is an important research topic in artificial intelligence, whose main goal is to integrate multimodal clues to identify human emotional states. Current works generally assume accurate labels for benchmark…

Emotion plays a fundamental role in human interaction, and therefore systems capable of identifying emotions in speech are crucial in the context of human-computer interaction. Speech emotion recognition (SER) is a challenging problem,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Lucas Ueda , João Lima , Leonardo Marques , Paula Costa

Emotion recognition,as a step toward mind reading,seeks to infer internal states from external cues.Most existing methods rely on explicit signals-such as facial expressions,speech,or gestures-that reflect only bodily responses and overlook…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Mengke Song , Yuge Xie , Qi Cui , Luming Li , Xinyu Liu , Guotao Wang , Chenglizhao Chen , Shanchen Pang

This paper presents a light-weight and accurate deep neural model for audiovisual emotion recognition. To design this model, the authors followed a philosophy of simplicity, drastically limiting the number of parameters to learn from the…

Artificial Intelligence · Computer Science 2018-08-09 Valentin Vielzeuf , Corentin Kervadec , Stéphane Pateux , Alexis Lechervy , Frédéric Jurie

Facial expression recognition (FER) in the wild is crucial for building reliable human-computer interactive systems. However, annotations of large scale datasets in FER has been a key challenge as these datasets suffer from noise due to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Darshan Gera , S Balasubramanian

Face Emotion Recognition (FER) is essential for social interactions and understanding others' mental states. Utilizing eye tracking to investigate FER has yielded insights into cognitive processes. In this study, we utilized an…

Human-Computer Interaction · Computer Science 2025-03-21 Meisam J. Seikavandi , Maria J. Barrett , Paolo Burelli

Introduction: Music provides an incredible avenue for individuals to express their thoughts and emotions, while also serving as a delightful mode of entertainment for enthusiasts and music lovers. Objectives: This paper presents a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Rajesh B , Keerthana V , Narayana Darapaneni , Anwesh Reddy P

Text-level discourse parsing aims to unmask how two sentences in the text are related to each other. We propose the task of Visual Discourse Parsing, which requires understanding discourse relations among scenes in a video. Here we use the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Arjun R. Akula , Song-Chun Zhu

Behavior recognition is an important task in video representation learning. An essential aspect pertains to effective feature learning conducive to behavior recognition. Recently, researchers have started to study fine-grained behavior…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Chengyang Hu , Yuduo Chen , Lizhuang Ma

Multi-modal conversation emotion recognition (MCER) aims to recognize and track the speaker's emotional state using text, speech, and visual information in the conversation scene. Analyzing and studying MCER issues is significant to…

Artificial Intelligence · Computer Science 2025-11-14 Yuntao Shou , Tao Meng , Wei Ai , Fangze Fu , Nan Yin , Keqin Li

Accessibility efforts for d/Deaf and hard of hearing (DHH) learners in video-based learning have mainly focused on captions and interpreters, with limited attention to learners' emotional awareness--an important yet challenging skill for…

Human-Computer Interaction · Computer Science 2025-03-11 Si Chen , Jason Situ , Haocong Cheng , Suzy Su , Desiree Kirst , Lu Ming , Qi Wang , Lawrence Angrave , Yun Huang

This study investigates the key characteristics and suitability of widely used Facial Expression Recognition (FER) datasets for training deep learning models. In the field of affective computing, FER is essential for interpreting human…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 F. Xavier Gaya-Morey , Cristina Manresa-Yee , Célia Martinie , Jose M. Buades-Rubio