English
Related papers

Related papers: SensEmo: Enabling Affective Learning through Real-…

200 papers

We present Affect2MM, a learning method for time-series emotion prediction for multimedia content. Our goal is to automatically capture the varying emotions depicted by characters in real-life human-centric situations and behaviors. We use…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Trisha Mittal , Puneet Mathur , Aniket Bera , Dinesh Manocha

An advanced emotion classification model was developed using a CNN-Transformer architecture for emotion recognition from EEG brain wave signals, effectively distinguishing among three emotional states, positive, neutral and negative. The…

Signal Processing · Electrical Eng. & Systems 2025-11-21 Roman Dolgopolyi , Antonis Chatzipanagiotou

Emotion is an intricate physiological response that plays a crucial role in how we respond and cooperate with others in our daily affairs. Numerous experiments have been evolved to recognize emotion, however still require exploration to…

Human-Computer Interaction · Computer Science 2023-11-20 Danastan Tasaouf Mridula , Abu Ahmed Ferdaus , Tanmoy Sarkar Pias

Facial Emotion Recognition has emerged as increasingly pivotal in the domain of User Experience, notably within modern usability testing, as it facilitates a deeper comprehension of user satisfaction and engagement. This study aims to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Amna Murtada , Omnia Abdelrhman , Tahani Abdalla Attia

In this paper, we present our solution for the semi-supervised learning track (MER-SEMI) in MER2025. We propose a comprehensive framework, grounded in the principle that "more is better," to construct a robust Mixture of Experts (MoE)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Jun Xie , Yingjian Zhu , Feng Chen , Zhenghao Zhang , Xiaohui Fan , Hongzhu Yi , Xinming Wang , Chen Yu , Yue Bi , Zhaoran Zhao , Xiongjun Guan , Zhepeng Wang

Stress is a complex issue with wide-ranging physical and psychological impacts on human daily performance. Specifically, acute stress detection is becoming a valuable application in contextual human understanding. Two common approaches to…

Machine Learning · Computer Science 2022-03-21 Van-Tu Ninh , Manh-Duy Nguyen , Sinéad Smyth , Minh-Triet Tran , Graham Healy , Binh T. Nguyen , Cathal Gurrin

This paper addresses the problem of modeling textual conversations and detecting emotions. Our proposed model makes use of 1) deep transfer learning rather than the classical shallow methods of word embedding; 2) self-attention mechanisms…

Computation and Language · Computer Science 2019-06-18 Waleed Ragheb , Jérôme Azé , Sandra Bringay , Maximilien Servajean

Affective computing plays a key role in human-computer interactions, entertainment, teaching, safe driving, and multimedia integration. Major breakthroughs have been made recently in the areas of affective computing (i.e., emotion…

Multimedia · Computer Science 2022-03-22 Yan Wang , Wei Song , Wei Tao , Antonio Liotta , Dawei Yang , Xinlei Li , Shuyong Gao , Yixuan Sun , Weifeng Ge , Wei Zhang , Wenqiang Zhang

Recently, wearable emotion recognition based on peripheral physiological signals has drawn massive attention due to its less invasive nature and its applicability in real-life scenarios. However, how to effectively fuse multimodal data…

Human-Computer Interaction · Computer Science 2023-04-03 Yujin Wu , Mohamed Daoudi , Ali Amad

Emotion has an important role in daily life, as it helps people better communicate with and understand each other more efficiently. Facial expressions can be classified into 7 categories: angry, disgust, fear, happy, neutral, sad and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Shaoyuan Xu , Yang Cheng , Qian Lin , Jan P. Allebach

This work presents the IMPROVE dataset, a multimodal resource designed to evaluate the effects of mobile phone usage on learners during online education. It includes behavioral, biometric, physiological, and academic performance data…

Human-Computer Interaction · Computer Science 2025-08-29 Roberto Daza , Alvaro Becerra , Ruth Cobos , Julian Fierrez , Aythami Morales

Consumers often react expressively to products such as food samples, perfume, jewelry, sunglasses, and clothing accessories. This research discusses a multimodal affect recognition system developed to classify whether a consumer likes or…

Human-Computer Interaction · Computer Science 2017-05-09 Amol S Patwardhan , Gerald M Knapp

Emotion recognition plays a crucial role in various domains of human-robot interaction. In long-term interactions with humans, robots need to respond continuously and accurately, however, the mainstream emotion recognition methods mostly…

Human-Computer Interaction · Computer Science 2024-01-23 Zihan Lin , Francisco Cruz , Eduardo Benitez Sandoval

In sensitive scenarios, such as meetings, negotiations, and team sports, messages must be conveyed without detection by non-collaborators. Previous methods, such as encrypting messages, eye contact, and micro-gestures, had problems with…

Human-Computer Interaction · Computer Science 2024-11-22 Hongxin Li , Jingsheng Tang , Xuechao Xu , Wei Dai , Yaru Liu , Junhao Xiao , Huimin Lu , Zongtan Zhou

Speech-based machine learning (ML) has been heralded as a promising solution for tracking prosodic and spectrotemporal patterns in real-life that are indicative of emotional changes, providing a valuable window into one's cognitive and…

Machine Learning · Computer Science 2021-09-08 Kexin Feng , Theodora Chaspari

This paper describes EmoRAG, a system designed to detect perceived emotions in text for SemEval-2025 Task 11, Subtask A: Multi-label Emotion Detection. We focus on predicting the perceived emotions of the speaker from a given text snippet,…

Computation and Language · Computer Science 2025-06-06 Lev Morozov , Aleksandr Mogilevskii , Alexander Shirnin

The Experience Sampling Method (ESM) introduces in-situ sampling of human behaviour, and provides researchers and behavioural therapists with ecologically valid and timely assessments of a person's psychological state. This, in turn, opens…

Human-Computer Interaction · Computer Science 2015-08-18 Veljko Pejovic , Neal Lathia , Cecilia Mascolo , Mirco Musolesi

Social interactions are fundamental to well-being, yet automatically detecting them in daily life-particularly using wearables-remains underexplored. Most existing systems are evaluated in controlled settings, focus primarily on in-person…

Wearables equipped with pervasive sensors enable us to monitor physiological and behavioral signals in our everyday life. We propose the WellAff system able to recognize affective states for wellbeing support. It also includes health care…

Research in automatic affect recognition has seldom addressed the issue of computational resource utilization. With the advent of ambient intelligence technology which employs a variety of low-power, resource-constrained devices, this issue…

Machine Learning · Computer Science 2020-06-01 Fasih Haider , Senja Pollak , Pierre Albert , Saturnino Luz