English
Related papers

Related papers: CAST-Phys: Contactless Affective States Through Ph…

200 papers

In the field of affective computing, researchers in the community have promoted the performance of models and algorithms by using the complementarity of multimodal information. However, the emergence of more and more modal information makes…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Binqiang Wang , Gang Dong , Yaqian Zhao , Rengang Li , Lu Cao , Lihua Lu

Emotion recognition is an important research direction in artificial intelligence, helping machines understand and adapt to human emotional states. Multimodal electrophysiological(ME) signals, such as EEG, GSR, respiration(Resp), and…

Multimedia · Computer Science 2023-08-07 Yunfei Guo , Tao Zhang , Wu Huang

Conversational agents (CAs) are revolutionizing human-computer interaction by evolving from text-based chatbots to empathetic digital humans (DHs) capable of rich emotional expressions. This paper explores the integration of neural and…

Human-Computer Interaction · Computer Science 2025-08-11 Nastaran Saffaryazdi , Tamil Selvan Gunasekaran , Kate Laveys , Elizabeth Broadbent , Mark Billinghurst

The development of agents with emotional intelligence is becoming increasingly vital due to their significant role in human-computer interaction and the growing integration of computer systems across various sectors of society. Affective…

Human-Computer Interaction · Computer Science 2026-05-05 Raziyeh Zall , Alireza Kheyrkhah , Erik Cambria , Zahra Naseri , M. Reza Kangavari

Emotion is well-recognized as a distinguished symbol of human beings, and it plays a crucial role in our daily lives. Existing vision-based or sensor-based solutions are either obstructive to use or rely on specialized hardware, hindering…

Human-Computer Interaction · Computer Science 2019-08-28 Yu Gu , Yantong Wang , Tao Liu , Yusheng Ji , Zhi Liu , Peng Li , Xiaoyan Wang , Xin An , Fuji Ren

Automatic emotion recognition has become increasingly important with the rise of AI, especially in fields like healthcare, education, and automotive systems. However, there is a lack of multimodal datasets, particularly involving body…

Artificial Intelligence · Computer Science 2025-09-09 Seyed Muhammad Hossein Mousavi , Atiye Ilanloo

Emotion Recognition (ER) is the process of analyzing and identifying human emotions from sensing data. Currently, the field heavily relies on facial expression recognition (FER) because visual channel conveys rich emotional cues. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Kejun Liu , Yuanyuan Liu , Lin Wei , Chang Tang , Yibing Zhan , Zijing Chen , Zhe Chen

The Facial Action Coding System (FACS) has been used by numerous studies to investigate the links between facial behavior and mental health. The laborious and costly process of FACS coding has motivated the development of machine learning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Evangelos Sariyanidi , Lisa Yankowitz , Robert T. Schultz , John D. Herrington , Birkan Tunc , Jeffrey Cohn

Emotion detection from faces is one of the machine learning problems needed for human-computer interaction. The variety of methods used is enormous, which motivated an in-depth review of articles and scientific studies. Three of the most…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Aleksandra Jamróz , Patrycja Wysocka , Piotr Garbat

Emotion recognition from physiological signals has substantial potential for applications in mental health and emotion-aware systems. However, the lack of standardized, large-scale evaluations across heterogeneous datasets limits progress…

Human-Computer Interaction · Computer Science 2026-04-08 Pragya Singh , Ankush Gupta , Somay Jalan , Mohan Kumar , Pushpendra Singh

Speech has been a widely used modality in the field of affective computing. Recently however, there has been a growing interest in the use of multi-modal affective computing systems. These multi-modal systems incorporate both verbal and…

Human-Computer Interaction · Computer Science 2018-05-18 Jonny O'Dwyer , Niall Murray , Ronan Flynn

Emotion recognition in social situations is a complex task that requires integrating information from both facial expressions and the situational context. While traditional approaches to automatic emotion recognition have focused on…

Human-Computer Interaction · Computer Science 2024-08-05 Bin Han , Cleo Yau , Su Lei , Jonathan Gratch

Emotion recognition from facial videos enables non-contact inference of human emotional states. Although facial expressions are widely used cues, they cannot fully reflect intrinsic affective states. Remote photoplethysmography (rPPG)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Xiwen Luo , Jia Li , Rencheng Song , Yu Liu , Juan Cheng

One of the challenges in virtual environments is the difficulty users have in interacting with these increasingly complex systems. Ultimately, endowing machines with the ability to perceive users emotions will enable a more intuitive and…

Human-Computer Interaction · Computer Science 2022-10-26 M. L. Menezes , A. Samara , L. Galway , A. Sant'anna , A. Verikas , F. Alonso-Fernandez , H. Wang , R. Bond

Multimodal emotion recognition from physiological signals is receiving an increasing amount of attention due to the impossibility to control them at will unlike behavioral reactions, thus providing more reliable information. Existing deep…

Human-Computer Interaction · Computer Science 2023-10-12 Eleonora Lopez , Eleonora Chiarantano , Eleonora Grassucci , Danilo Comminiello

Emotion recognition aims to interpret the emotional states of a person based on various inputs including audio, visual, and textual cues. This paper focuses on emotion recognition using visual features. To leverage the correlation between…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Akshita Mittel , Shashank Tripathi

Emotion recognition is a fundamental component of next-generation human-computer interaction (HCI), enabling machines to perceive, understand, and respond to users' affective states. However, existing systems often rely on single-modality…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Ziwen Zhong , Zhitao Shu , Yue Zhao

Understanding the mental state of other people is an important skill for intelligent agents and robots to operate within social environments. However, the mental processes involved in `mind-reading' are complex. One explanation of such…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Jonathan Vitale , Mary-Anne Williams , Benjamin Johnston , Giuseppe Boccignone

Compared to other modalities, electroencephalogram (EEG) based emotion recognition can intuitively respond to emotional patterns in the human brain and, therefore, has become one of the most focused tasks in affective computing. The nature…

Signal Processing · Electrical Eng. & Systems 2024-08-14 Chenyu Liu , Xinliang Zhou , Yihao Wu , Yi Ding , Liming Zhai , Kun Wang , Ziyu Jia , Yang Liu

Agents must monitor their partners' affective states continuously in order to understand and engage in social interactions. However, methods for evaluating affect recognition do not account for changes in classification performance that may…

Human-Computer Interaction · Computer Science 2025-09-08 Allen Chang , Lauren Klein , Marcelo R. Rosales , Weiyang Deng , Beth A. Smith , Maja J. Matarić