English
Related papers

Related papers: Decision-Level Fusion for Robust Wearable Affect R…

200 papers

Multimodal federated learning (FL) aims to enrich model training in FL settings where devices are collecting measurements across multiple modalities (e.g., sensors measuring pressure, motion, and other types of data). However, key…

Machine Learning · Computer Science 2024-08-21 Liangqi Yuan , Dong-Jun Han , Vishnu Pandi Chellapandi , Stanislaw H. Żak , Christopher G. Brinton

Emotion recognition from physiological signals remains challenging due to their non-stationary, noisy, and subject-dependent characteristics. This work presents, to the best of our knowledge, the first comprehensive application of liquid…

Signal Processing · Electrical Eng. & Systems 2026-02-10 Anindya Bhattacharjee , Nittya Ananda Biswas , K. A. Shahriar , Adib Rahman

In-vehicle emotion recognition underpins adaptive driver-assistance systems and, ultimately, occupant safety. However, practical deployment is hindered by (i) modality fragility - poor lighting and occlusions degrade vision-based methods;…

Machine Learning · Computer Science 2025-07-23 Baran Can Gül , Suraksha Nadig , Stefanos Tziampazis , Nasser Jazdi , Michael Weyrich

Sentiment analysis models exhibit complementary strengths, yet existing approaches lack a unified framework for effective integration. We present SentiFuse, a flexible and model-agnostic framework that integrates heterogeneous sentiment…

Computation and Language · Computer Science 2026-02-03 Hieu Minh Duong , Rupa Ghosh , Cong Hoan Nguyen , Eugene Levin , Todd Gary , Long Nguyen

This paper presents a technique that combines the occurrence of certain events, as observed by different sensors, in order to detect and classify objects. This technique explores the extent of dependence between features being observed by…

Signal Processing · Electrical Eng. & Systems 2018-10-02 Siddharth Roheda , Hamid Krim , Zhi-Quan Luo , Tianfu Wu

We participated in the 10th ABAW Challenge, focusing on the Emotional Mimicry Intensity (EMI) Estimation track on the Hume-Vidmimic2 dataset. This task aims to predict six continuous emotion dimensions: Admiration, Amusement, Determination,…

Artificial Intelligence · Computer Science 2026-03-17 Jiawen Huang , Chenxi Huang , Zhuofan Wen , Hailiang Yao , Shun Chen , Longjiang Yang , Cong Yu , Fengyu Zhang , Ran Liu , Bin Liu

In this paper, we present our advanced solutions to the two sub-challenges of Affective Behavior Analysis in the wild (ABAW) 2023: the Emotional Reaction Intensity (ERI) Estimation Challenge and Expression (Expr) Classification Challenge.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Jia Li , Yin Chen , Xuesong Zhang , Jiantao Nie , Ziqiang Li , Yangchen Yu , Yan Zhang , Richang Hong , Meng Wang

Multimodal emotion analysis performed better in emotion recognition depending on more comprehensive emotional clues and multimodal emotion dataset. In this paper, we developed a large multimodal emotion dataset, named "HED" dataset, to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Zhongyu Fang , Aoyun He , Qihui Yu , Baopeng Gao , Weiping Ding , Tong Zhang , Lei Ma

Facial Emotion Recognition is a critical research area within Affective Computing due to its wide-ranging applications in Human Computer Interaction, mental health assessment and fatigue monitoring. Current FER methods predominantly rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Laura Rayón Ropero , Jasper De Laet , Filip Lemic , Pau Sabater Nácher , Nabeel Nisar Bhat , Sergi Abadal , Jeroen Famaey , Eduard Alarcón , Xavier Costa-Pérez

Introduction. We investigate the generalization ability of models built on datasets containing a small number of subjects, recorded in single study protocols. Next, we propose and evaluate methods combining these datasets into a single,…

Machine Learning · Computer Science 2023-12-05 Gideon Vos , Kelly Trinh , Zoltan Sarnyai , Mostafa Rahimi Azghadi

Affective Behavior Analysis aims to facilitate technology emotionally smart, creating a world where devices can understand and react to our emotions as humans do. To comprehensively evaluate the authenticity and applicability of emotional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Wei Zhang , Feng Qiu , Chen Liu , Lincheng Li , Heming Du , Tiancheng Guo , Xin Yu

Emotion recognition has the potential to play a pivotal role in enhancing human-computer interaction by enabling systems to accurately interpret and respond to human affect. Yet, capturing emotions in face-to-face contexts remains…

In human interactions, emotion recognition is crucial. For this reason, the topic of computer-vision approaches for automatic emotion recognition is currently being extensively researched. Processing multi-channel electroencephalogram (EEG)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Joshua Bègue , Mohamed Aymen Labiod , Abdelhamid Melloulk

We present MDEAW, a multimodal database consisting of Electrodermal Activity (EDA) and Photoplethysmography (PPG) signals recorded during the exams for the course taught by the teacher at Eurecat Academy, Sabadell, Barcelona in order to…

Human-Computer Interaction · Computer Science 2022-07-15 Arijit Nandi , Fatos Xhafa , Laia Subirats , Santi Fort

Multimodal sentiment analysis (MSA) is a research field that recognizes human sentiments by combining textual, visual, and audio modalities. The main challenge lies in integrating sentiment-related information from different modalities,…

Multimedia · Computer Science 2025-12-02 Heng Xie , Kang Zhu , Zhengqi Wen , Jianhua Tao , Xuefei Liu , Ruibo Fu , Changsheng Li

Agents must monitor their partners' affective states continuously in order to understand and engage in social interactions. However, methods for evaluating affect recognition do not account for changes in classification performance that may…

Human-Computer Interaction · Computer Science 2025-09-08 Allen Chang , Lauren Klein , Marcelo R. Rosales , Weiyang Deng , Beth A. Smith , Maja J. Matarić

Electroencephalography (EEG)-based emotion recognition plays a critical role in affective computing and emerging decision-support systems, yet remains challenging due to high-dimensional, noisy, and subject-dependent signals. This study…

Machine Learning · Computer Science 2026-02-09 S M Rakib UI Karim , Wenyi Lu , Diponkor Bala , Rownak Ara Rasul , Sean Goggins

FeFETs hold strong potential for advancing memory and logic technologies, but their inherent randomness arising from both operational cycling and fabrication variability poses significant challenges for accurate and reliable modeling.…

Machine Learning · Computer Science 2025-08-06 Tasnia Nobi Afee , Jack Hutchins , Md Mazharul Islam , Thomas Kampfe , Ahmedullah Aziz

In this paper, we study different approaches for classifying emotions from speech using acoustic and text-based features. We propose to obtain contextualized word embeddings with BERT to represent the information contained in speech…

Machine Learning · Computer Science 2024-03-28 Leonardo Pepino , Pablo Riera , Luciana Ferrer , Agustin Gravano

Robust semantic perception for autonomous vehicles relies on effectively combining multiple sensors with complementary strengths and weaknesses. State-of-the-art sensor fusion approaches to semantic perception often treat sensor data…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Tim Broedermannn , Christos Sakaridis , Luigi Piccinelli , Wim Abbeloos , Luc Van Gool