English
Related papers

Related papers: HAPI: A Model for Learning Robot Facial Expression…

200 papers

As robots become increasingly integrated into various industries, understanding how humans respond to robotic failures is critical. This study systematically examines trust dynamics and system design by analyzing human reactions to robot…

Robotics · Computer Science 2025-05-08 Ponkoj Chandra Shill , Md. Azizul Hakim

To construct effective teaming strategies between humans and AI systems in complex, risky situations requires an understanding of individual preferences and behaviors of humans. Previously this problem has been treated in case-specific or…

Human-Computer Interaction · Computer Science 2022-11-24 Jonathan A. DeCastro , Deepak Gopinath , Guy Rosman , Emily Sumner , Shabnam Hakimi , Simon Stent

It is in high demand to generate facial animation with high realism, but it remains a challenging task. Existing approaches of speech-driven facial animation can produce satisfactory mouth movement and lip synchronization, but show weakness…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Yutong Chen , Junhong Zhao , Wei-Qiang Zhang

Humans make complex inferences on faces, ranging from objective properties (gender, ethnicity, expression, age, identity, etc) to subjective judgments (facial attractiveness, trustworthiness, sociability, friendliness, etc). While the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-12 Amanda Song , Linjie Li , Chad Atalla , Garrison Cottrell

Learning from human feedback is a popular approach to train robots to adapt to user preferences and improve safety. Existing approaches typically consider a single querying (interaction) format when seeking human feedback and do not…

Robotics · Computer Science 2026-01-16 Yashwanthi Anand , Nnamdi Nwagwu , Kevin Sabbe , Naomi T. Fitter , Sandhya Saisubramanian

Detecting empathy from video interactions has emerging applications, yet raw videos that could be used for training AI models are rarely available due to privacy and ethical constraints. Public benchmarks are consequently released only as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Md Rakibul Hasan , Md Zakir Hossain , Aneesh Krishna , Shafin Rahman , Tom Gedeon

Emotion regulation is a crucial skill for managing emotions in everyday life, yet finding a constructive and accessible method to support these processes remains challenging due to their cognitive demands. In this study, we explore how…

Human-Computer Interaction · Computer Science 2025-07-01 Guy Laban , Julie Wang , Hatice Gunes

Being able to recognize emotions in human users is considered a highly desirable trait in Human-Robot Interaction (HRI) scenarios. However, most contemporary approaches rarely attempt to apply recognized emotional features in an active…

Human-Computer Interaction · Computer Science 2018-07-27 Nikhil Churamani , Alexander Sutherland , Pablo Barros

In this paper we present a fully autonomous and intrinsically motivated robot usable for HRI experiments. We argue that an intrinsically motivated approach based on the Predictive Information formalism, like the one presented here, could…

Human-Computer Interaction · Computer Science 2019-07-19 Marcus M. Scheunemann , Christoph Salge , Kerstin Dautenhahn

Emotions are an essential element in verbal communication, so understanding individuals' affect during a human-robot interaction (HRI) becomes imperative. This paper investigates the application of vision transformer models, namely ViT…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-18 Ruchik Mishra , Andrew Frye , Madan Mohan Rayguru , Dan O. Popa

The paper presents an experiment on the effects of adaptive emotional alignment between agents, considered a prerequisite for empathic communication, in Human-Robot Interaction (HRI). Using the NAO robot, we investigate the impact of an…

Quadruped robots are showing impressive abilities to navigate the real world. If they are to become more integrated into society, social trust in interactions with humans will become increasingly important. Additionally, robots will need to…

Robotics · Computer Science 2024-07-01 Alessandra Chappuis , Guillaume Bellegarda , Auke Ijspeert

This paper proposes a method to review public acceptance of products based on their brand by analyzing the facial expression of the customer intending to buy the product from a supermarket or hypermarket. In such cases, facial expression…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Vikrant Chaugule , Abhishek D , Aadheeshwar Vijayakumar , Pravin Bhaskar Ramteke , Shashidhar G. Koolagudi

Generative AI (GenAI) has rapidly entered education, yet its user experience is often explained through adoption-oriented constructs such as usefulness, ease of use, and engagement. We argue that these constructs are no longer sufficient…

Computers and Society · Computer Science 2026-03-26 Xiaoming Zhai

Aligning language models with human preferences through reinforcement learning from human feedback is crucial for their safe and effective deployment. The human preference is typically represented through comparison where one response is…

Machine Learning · Computer Science 2025-07-15 Hoang Anh Just , Ming Jin , Anit Sahu , Huy Phan , Ruoxi Jia

Recognizing human emotion/expressions automatically is quite an expected ability for intelligent robotics, as it can promote better communication and cooperation with humans. Current deep-learning-based algorithms may achieve impressive…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Tao Pu , Tianshui Chen , Yuan Xie , Hefeng Wu , Liang Lin

Emotion Representation Mapping (ERM) has the goal to convert existing emotion ratings from one representation format into another one, e.g., mapping Valence-Arousal-Dominance annotations for words or sentences into Ekman's Basic Emotions…

Computation and Language · Computer Science 2018-06-26 Sven Buechel , Udo Hahn

Accurate prediction of human behavior is crucial for effective human-robot interaction (HRI) systems, especially in dynamic environments where real-time decisions are essential. This paper addresses the challenge of forecasting future human…

Robotics · Computer Science 2026-03-17 Wentao Gao , Cheng Zhou

As voice assistants (VAs) become increasingly integrated into daily life, the need for emotion-aware systems that can recognize and respond appropriately to user emotions has grown. While significant progress has been made in speech emotion…

Human-Computer Interaction · Computer Science 2025-02-24 Yong Ma , Yuchong Zhang , Di Fu , Stephanie Zubicueta Portales , Danica Kragic , Morten Fjeld

Assistive robots interact with humans and must adapt to different users' preferences to be effective. An easy and effective technique to learn non-expert users' preferences is through rankings of robot behaviors, for example, robot movement…

Robotics · Computer Science 2024-11-19 Nathaniel Dennler , Zhonghao Shi , Stefanos Nikolaidis , Maja Matarić