English
Related papers

Related papers: Building BROOK: A Multi-modal and Facial Video Dat…

200 papers

We present AMIGOS-- A dataset for Multimodal research of affect, personality traits and mood on Individuals and GrOupS. Different to other databases, we elicited affect using both short and long videos in two social contexts, one with…

Neurons and Cognition · Quantitative Biology 2017-04-14 Juan Abdon Miranda-Correa , Mojtaba Khomami Abadi , Nicu Sebe , Ioannis Patras

Human face-to-face conversation is an ideal model for human-computer dialogue. One of the major features of face-to-face communication is its multiplicity of communication channels that act on multiple modalities. To realize a natural…

cmp-lg · Computer Science 2008-02-03 Katashi Nagao , Akikazu Takeuchi

There is a growing interest in more intelligent natural user interaction with the car. Hand gestures and speech are already being applied for driver-car interaction. Moreover, multimodal approaches are also showing promise in the automotive…

Human-Computer Interaction · Computer Science 2021-07-27 Abdul Rafey Aftab , Michael von der Beeck , Steven Rohrhirsch , Benoit Diotte , Michael Feld

Emotional expressiveness captures the extent to which a person tends to outwardly display their emotions through behavior. Due to the close relationship between emotional expressiveness and behavioral health, as well as the crucial role…

Human-Computer Interaction · Computer Science 2020-09-02 Victoria Lin , Jeffrey M. Girard , Michael A. Sayette , Louis-Philippe Morency

Reliable stress recognition is critical in applications such as medical monitoring and safety-critical systems, including real-world driving. While stress is commonly detected using physiological signals such as perinasal perspiration and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Paraskevi Valergaki , Vassilis C. Nicodemou , Iason Oikonomidis , Antonis Argyros , Anastasios Roussos

In recent years, Affective Computing and its applications have become a fast-growing research topic. Furthermore, the rise of Deep Learning has introduced significant improvements in the emotion recognition system compared to classical…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Joaquim Comas , Decky Aspandi , Xavier Binefa

Excessive alcohol consumption causes disability and death. Digital interventions are promising means to promote behavioral change and thus prevent alcohol-related harm, especially in critical moments such as driving. This requires real-time…

Human-Computer Interaction · Computer Science 2023-05-02 Kevin Koch , Martin Maritsch , Eva van Weenen , Stefan Feuerriegel , Matthias Pfäffli , Elgar Fleisch , Wolfgang Weinmann , Felix Wortmann

A smart vehicle should be able to monitor the actions and behaviors of the human driver to provide critical warnings or intervene when necessary. Recent advancements in deep learning and computer vision have shown great promise in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Sumit Jha , Mohamed F. Marzban , Tiancheng Hu , Mohamed H. Mahmoud , Naofal Al-Dhahir , Carlos Busso

Autonomous vehicles need to accomplish their tasks while interacting with human drivers in traffic. It is thus crucial to equip autonomous vehicles with artificial reasoning to better comprehend the intentions of the surrounding traffic,…

Artificial Intelligence · Computer Science 2023-11-02 Xiao Li , Kaiwen Liu , H. Eric Tseng , Anouck Girard , Ilya Kolmanovsky

Affective Behavior Analysis aims to facilitate technology emotionally smart, creating a world where devices can understand and react to our emotions as humans do. To comprehensively evaluate the authenticity and applicability of emotional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Wei Zhang , Feng Qiu , Chen Liu , Lincheng Li , Heming Du , Tiancheng Guo , Xin Yu

Social anxiety is a prevalent condition that affects interpersonal interactions and social functioning. Recent advances in artificial intelligence and social robotics offer new opportunities to examine social anxiety in the human-robot…

Robotics · Computer Science 2025-11-18 Vesna Poprcova , Iulia Lefter , Matthias Wieser , Martijn Warnier , Frances Brazier

Humans are arguably innately prepared to comprehend others' emotional expressions from subtle body movements. If robots or computers can be empowered with this capability, a number of robotic applications become possible. Automatically…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Yu Luo , Jianbo Ye , Reginald B. Adams, , Jia Li , Michelle G. Newman , James Z. Wang

In-vehicle emotion recognition underpins adaptive driver-assistance systems and, ultimately, occupant safety. However, practical deployment is hindered by (i) modality fragility - poor lighting and occlusions degrade vision-based methods;…

Machine Learning · Computer Science 2025-07-23 Baran Can Gül , Suraksha Nadig , Stefanos Tziampazis , Nasser Jazdi , Michael Weyrich

Visual recognition inside the vehicle cabin leads to safer driving and more intuitive human-vehicle interaction but such systems face substantial obstacles as they need to capture different granularities of driver behaviour while dealing…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Alina Roitberg , Kunyu Peng , Zdravko Marinov , Constantin Seibold , David Schneider , Rainer Stiefelhagen

The facial expression generation capability of humanoid social robots is critical for achieving natural and human-like interactions, playing a vital role in enhancing the fluidity of human-robot interactions and the accuracy of emotional…

Robotics · Computer Science 2025-10-28 Yongtong Zhu , Lei Li , Iggy Qian , WenBin Zhou , Ye Yuan , Qingdu Li , Na Liu , Jianwei Zhang

Emotion recognition has the potential to play a pivotal role in enhancing human-computer interaction by enabling systems to accurately interpret and respond to human affect. Yet, capturing emotions in face-to-face contexts remains…

With the rapid advancements in multimodal generative technology, Affective Computing research has provoked discussion about the potential consequences of AI systems equipped with emotional intelligence. Affective Computing involves the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Shreya Ghosh , Zhixi Cai , Abhinav Dhall , Dimitrios Kollias , Roland Goecke , Tom Gedeon

Predicting the behaviors of other road users is crucial to safe and intelligent decision-making for autonomous vehicles (AVs). However, most motion prediction models ignore the influence of the AV's actions and the planning module has to…

Robotics · Computer Science 2023-02-09 Zhiyu Huang , Haochen Liu , Jingda Wu , Wenhui Huang , Chen Lv

Significant advancements have been made in developing parametric models for digital humans, with various approaches concentrating on parts such as the human body, hand, or face. Nevertheless, connectors such as the neck have been overlooked…

Graphics · Computer Science 2023-05-09 Longwen Zhang , Zijun Zhao , Xinzhou Cong , Qixuan Zhang , Shuqi Gu , Yuchong Gao , Rui Zheng , Wei Yang , Lan Xu , Jingyi Yu

This work presents a methodology for modeling and predicting human behavior in settings with N humans interacting in highly multimodal scenarios (i.e. where there are many possible highly-distinct futures). A motivating example includes…

Robotics · Computer Science 2018-07-27 Boris Ivanovic , Edward Schmerling , Karen Leung , Marco Pavone