English
Related papers

Related papers: Towards Inclusive HRI: Using Sim2Real to Address U…

200 papers

Human communication is the vocal and non verbal signal to communicate with others. Human expression is a significant biometric object in picture and record databases of surveillance systems. Face appreciation has a serious role in biometric…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 P. Deivendran , P. Suresh Babu , G. Malathi , K. Anbazhagan , R. Senthil Kumar

We propose two face representations that are blind to facial expressions associated to emotional responses. This work is in part motivated by new international regulations for personal data protection, which enforce data controllers to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Alejandro Peña , Julian Fierrez , Agata Lapedriza , Aythami Morales

Synthetic data has emerged as a promising alternative for training face recognition (FR) models, offering advantages in scalability, privacy compliance, and potential for bias mitigation. However, critical questions remain on whether both…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Pavel Korshunov , Ketan Kotwal , Christophe Ecabert , Vidit Vidit , Amir Mohammadi , Sebastien Marcel

Facial expression recognition has gained significance as a means of imparting social robots with the capacity to discern the emotional states of users. The use of social robotics includes a variety of settings, including homes, nursing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 F. Xavier Gaya-Morey , Silvia Ramis , Jose M. Buades-Rubio , Cristina Manresa-Yee

Facial motion capture in mixed reality headsets enables real-time avatar animation, allowing users to convey non-verbal cues during virtual interactions. However, as facial motion data constitutes a behavioral biometric, its use raises…

Cryptography and Security · Computer Science 2025-07-16 Adriano Castro , Simon Hanisch , Matin Fallahi , Thorsten Strufe

Human emotions analysis has been the focus of many studies, especially in the field of Affective Computing, and is important for many applications, e.g. human-computer intelligent interaction, stress analysis, interactive games, animations,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Mohammad Rami Koujan , Luma Alharbawee , Giorgos Giannakakis , Nicolas Pugeault , Anastasios Roussos

Effective human-AI interaction relies on AI's ability to accurately perceive and interpret human emotions. Current benchmarks for vision and vision-language models are severely limited, offering a narrow emotional spectrum that overlooks…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Christoph Schuhmann , Robert Kaczmarczyk , Gollam Rabby , Felix Friedrich , Maurice Kraus , Krishna Kalyan , Kourosh Nadi , Huu Nguyen , Kristian Kersting , Sören Auer

Large vision models based in deep learning architectures have been consistently advancing the state-of-the-art in biometric recognition. However, three weaknesses are commonly reported for such kind of approaches: 1) their extreme demands…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Henrique Jesus , Hugo Proença

As robots enter human workspaces, there is a crucial need for them to comprehend embodied human instructions, enabling intuitive and fluent human-robot interaction (HRI). However, accurate comprehension is challenging due to a lack of…

Recent work in sim2real has successfully enabled robots to act in physical environments by training in simulation with a diverse ''population'' of environments (i.e. domain randomization). In this work, we focus on enabling generalization…

Machine Learning · Computer Science 2022-12-07 Jerry Zhi-Yang He , Aditi Raghunathan , Daniel S. Brown , Zackory Erickson , Anca D. Dragan

Affective computing and cognitive theory are widely used in modern human-computer interaction scenarios. Human faces, as the most prominent and easily accessible features, have attracted great attention from researchers. Since humans have…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Wenxuan Wang , Yanwei Fu , Qiang Sun , Tao Chen , Chenjie Cao , Ziqi Zheng , Guoqiang Xu , Han Qiu , Yu-Gang Jiang , Xiangyang Xue

The integration of dialogue interfaces in mobile devices has become ubiquitous, providing a wide array of services. As technology progresses, humanoid robots designed with human-like features to interact effectively with people are gaining…

Human-Computer Interaction · Computer Science 2025-01-14 Mohamed Ala Yahyaoui , Mouaad Oujabour , Leila Ben Letaifa , Amine Bohi

Scaling data volume and diversity is critical for generalizing embodied intelligence. While synthetic data generation offers a scalable alternative to expensive physical data acquisition, transferring robotic manipulation policies from…

Explanations of an AI's function can assist human decision-makers, but the most useful explanation depends on the decision's context, referred to as the downstream task. User studies are necessary to determine the best explanations for each…

Human-Computer Interaction · Computer Science 2024-09-20 Eura Nofshin , Esther Brown , Brian Lim , Weiwei Pan , Finale Doshi-Velez

The facial expression generation capability of humanoid social robots is critical for achieving natural and human-like interactions, playing a vital role in enhancing the fluidity of human-robot interactions and the accuracy of emotional…

Robotics · Computer Science 2025-10-28 Yongtong Zhu , Lei Li , Iggy Qian , WenBin Zhou , Ye Yuan , Qingdu Li , Na Liu , Jianwei Zhang

Accurate pain assessment in patients with limited ability to communicate, such as older adults with severe dementia, represents a critical healthcare challenge. Robust automated systems of pain behavior detection may facilitate such…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Babak Taati , Muhammad Muzammil , Yasamin Zarghami , Abhishek Moturu , Amirhossein Kazerouni , Hailey Reimer , Alex Mihailidis , Thomas Hadjistavropoulos

Facial Expression Recognition faces two core challenges. The first is class imbalance in public datasets, which skews the learning process and weakens generalization. The second is related to privacy and data collection constraints, which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ali Azmoudeh , Erdi Sarıtaş , Ömer Yıldırım , Hazım Kemal Ekenel

Emotions are reactions that can be expressed through a variety of social signals. For example, anger can be expressed through a scowl, narrowed eyes, a long stare, or many other expressions. This complexity is problematic when attempting to…

Robotics · Computer Science 2021-03-09 Ghazal Saheb Jam , Jimin Rhim , Angelica Lim

As robots and artificial agents become increasingly integrated into daily life, enhancing their ability to interact with humans is essential. Emotions, which play a crucial role in human interactions, can improve the naturalness and…

Robotics · Computer Science 2025-04-17 Francesca Corrao , Alice Nardelli , Jennifer Renoux , Carmine Tommaso Recchiuto

Over the past decade, Extended Reality (XR), including Virtual, Augmented, and Mixed Reality, gained attention as a research instrument in human-robot interaction studies, but remains underexplored in empirical investigations of social…

Robotics · Computer Science 2026-02-20 André Helgert , Carolin Straßmann , Sabrina C. Eimler