English
Related papers

Related papers: Facial Expression and Peripheral Physiology Fusion…

200 papers

Patient pain can be detected highly reliably from facial expressions using a set of facial muscle-based action units (AUs) defined by the Facial Action Coding System (FACS). A key characteristic of facial expression of pain is the…

Machine Learning · Computer Science 2018-02-21 Zhanli Chen , Rashid Ansari , Diana J. Wilkie

Facial Emotion Analysis (FEA) plays a crucial role in visual affective computing, aiming to infer a person's emotional state based on facial data. Scientifically, facial expressions (FEs) result from the coordinated movement of facial…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zhuozhao Hu , Kaishen Yuan , Xin Liu , Zitong Yu , Yuan Zong , Jingang Shi , Huanjing Yue , Jingyu Yang

Multimodal emotion understanding requires effective integration of text, audio, and visual modalities for both discrete emotion recognition and continuous sentiment analysis. We present EGMF, a unified framework combining expert-guided…

Computation and Language · Computer Science 2026-01-13 Jiaqi Qiao , Xiujuan Xu , Xinran Li , Yu Liu

Facial Expression Recognition (FER) is a critical task within computer vision with diverse applications across various domains. Addressing the challenge of limited FER datasets, which hampers the generalization capability of expression…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Bach Nguyen-Xuan , Thien Nguyen-Hoang , Thanh-Huy Nguyen , Nhu Tai-Do

Facial behavior analysis is a broad topic with various categories such as facial emotion recognition, age, and gender recognition. Many studies focus on individual tasks while the multi-task learning approach is still an open research issue…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Dang-Khanh Nguyen , Sudarshan Pant , Ngoc-Huynh Ho , Guee-Sang Lee , Soo-Huyng Kim , Hyung-Jeong Yang

Emotion recognition based on Electroencephalography (EEG) has gained significant attention and diversified development in fields such as neural signal processing and affective computing. However, the unique brain anatomy of individuals…

Signal Processing · Electrical Eng. & Systems 2024-05-31 Yihang Dong , Xuhang Chen , Yanyan Shen , Michael Kwok-Po Ng , Tao Qian , Shuqiang Wang

Trust and perceived safety play a crucial role in the public acceptance of automated vehicles. To understand perceived risk, an experiment was conducted using a driving simulator under two automated driving styles and optionally introducing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Abel van Elburg , Konstantinos Gkentsidis , Mathieu Sarrazin , Sarah Barendswaard , Varun Kotian , Riender Happee

We present the early-stage design and implementation of a multimodal, real-time communication analysis system intended as a foundational interaction layer for adaptive VR training. The system integrates five parallel processing streams: (1)…

Human-Computer Interaction · Computer Science 2026-04-14 Birgit Nierula , Karam Tomotaki-Dawoud , Daniel Johannes Meyer , Iryna Ignatieva , Mina Mottahedin , Thomas Koch , Sebastian Bosse

Multi-modal emotion recognition is challenging due to the difficulty of extracting features that capture subtle emotional differences. Understanding multi-modal interactions and connections is key to building effective bimodal speech…

Sound · Computer Science 2025-03-25 Jiachen Luo , Huy Phan , Lin Wang , Joshua D. Reiss

The rapid expansion of social media platforms has provided unprecedented access to massive amounts of multimodal user-generated content. Comprehending user emotions can provide valuable insights for improving communication and understanding…

Social and Information Networks · Computer Science 2025-01-15 Sree Bhattacharyya , Shuhua Yang , James Z. Wang

Facial expression is a way of communication that can be used to interact with computers or other electronic devices and the recognition of emotion from faces is an emerging practice with application in many fields. There are many…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Salik Ram Khanal , Prabin Sharma , Hugo Fernandes , João Barroso , Vítor Manuel de Jesus Filipe

Human motion characteristics are used to monitor the progression of neurological diseases and mood disorders. Since perceptions of emotions are also interleaved with body posture and movements, emotion recognition from human gait can be…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Matthew Malek-Podjaski , Fani Deligianni

Classification of human emotions can play an essential role in the design and improvement of human-machine systems. While individual biological signals such as Electrocardiogram (ECG) and Electrodermal Activity (EDA) have been widely used…

Machine Learning · Computer Science 2021-08-06 Anubhav Bhatti , Behnam Behinaein , Dirk Rodenburg , Paul Hungler , Ali Etemad

There is an increasing scientific interest in automatically analysing and understanding human behavior, with particular reference to the evolution of facial expressions and the recognition of the corresponding emotions. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Rongjiao Ji , Alessandra Micheletti , Natasa Krklec Jerinkic , Zoranka Desnica

Recently, emotion recognition based on physiological signals has emerged as a field with intensive research. The utilization of multi-modal, multi-channel physiological signals has significantly improved the performance of emotion…

Multimedia · Computer Science 2023-08-22 Xinda Li

In the domain of human-computer interaction, accurately recognizing and interpreting human emotions is crucial yet challenging due to the complexity and subtlety of emotional expressions. This study explores the potential for detecting a…

Multimedia · Computer Science 2025-05-13 Jiehui Jia , Huan Zhang , Jinhua Liang

In this paper we propose a fusion approach to continuous emotion recognition that combines visual and auditory modalities in their representation spaces to predict the arousal and valence levels. The proposed approach employs a pre-trained…

Machine Learning · Computer Science 2019-06-26 Juan D. S. Ortega , Patrick Cardinal , Alessandro L. Koerich

Nowadays, with the explosive growth of multimodal reviews on social media platforms, multimodal sentiment analysis has recently gained popularity because of its high relevance to these social media posts. Although most previous studies…

Computation and Language · Computer Science 2022-01-26 Luwei Xiao , Xingjiao Wu , Wen Wu , Jing Yang , Liang He

Face Emotion Recognition (FER) is essential for social interactions and understanding others' mental states. Utilizing eye tracking to investigate FER has yielded insights into cognitive processes. In this study, we utilized an…

Human-Computer Interaction · Computer Science 2025-03-21 Meisam J. Seikavandi , Maria J. Barrett , Paolo Burelli

This book provides a comprehensive exploration of affective computing and human-computer interaction technologies. It begins with the historical development and basic concepts of human-computer interaction, delving into the technical…

Human-Computer Interaction · Computer Science 2025-06-19 Changzeng Fu