English
Related papers

Related papers: Multi-face emotion detection for effective Human-R…

200 papers

Humans use a host of signals to infer the emotional state of others. In general, computer systems that leverage signals from multiple modalities will be more robust and accurate in the same task. We present a multimodal affect and context…

Human-Computer Interaction · Computer Science 2019-03-29 Daniel McDuff , Kael Rowan , Piali Choudhury , Jessica Wolk , ThuVan Pham , Mary Czerwinski

Classification of human emotions remains an important and challenging task for many computer vision algorithms, especially in the era of humanoid robots which coexist with humans in their everyday life. Currently proposed methods for…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Ivona Tautkute , Tomasz Trzcinski , Adam Bielski

The integration of conversational agents into our daily lives has become increasingly common, yet many of these agents cannot engage in deep interactions with humans. Despite this, there is a noticeable shortage of datasets that capture…

Human-Computer Interaction · Computer Science 2025-03-19 Mohammed Althubyani , Zhijin Meng , Shengyuan Xie , Cha Seung , Imran Razzak , Eduardo B. Sandoval , Baki Kocaballi , Francisco Cruz

Artificial Intelligence (AI) has significantly advanced in recent years, driving innovation across various fields, especially in robotics. Even though robots can perform complex tasks with increasing autonomy, challenges remain in ensuring…

Human-Computer Interaction · Computer Science 2025-03-24 Anargh Viswanath , Lokesh Veeramacheneni , Hendrik Buschmeier

Collaborative interactions require social robots to adapt to the dynamics of human affective behaviour. Yet, current approaches for affective behaviour generation in robots focus on instantaneous perception to generate a one-to-one mapping…

Robotics · Computer Science 2022-02-28 Nikhil Churamani , Pablo Barros , Hatice Gunes , Stefan Wermter

Body movements carry important information about a person's emotions or mental state and are essential in daily communication. Enhancing the ability of machines to understand emotions expressed through body language can improve the…

Artificial Intelligence · Computer Science 2023-04-06 Chenyan Wu , Dolzodmaa Davaasuren , Tal Shafir , Rachelle Tsachor , James Z. Wang

As the use of Augmented Reality (AR) to enhance interactions between human agents and robotic systems in a work environment continues to grow, robots must communicate their intents in informative yet straightforward ways. This improves the…

Robotics · Computer Science 2023-03-13 Chrisantus Eze , Christopher Crick

Assistive robots can potentially improve the quality of life and personal independence of elderly people by supporting everyday life activities. To guarantee a safe and intuitive interaction between human and robot, human intentions need to…

Robotics · Computer Science 2019-07-05 Susanne Trick , Dorothea Koert , Jan Peters , Constantin Rothkopf

This paper proposes a multimodal emotion recognition system based on hybrid fusion that classifies the emotions depicted by speech utterances and corresponding images into discrete classes. A new interpretability technique has been…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Puneet Kumar , Sarthak Malik , Balasubramanian Raman

Automated dialogue systems are important applications of artificial intelligence, and traditional systems struggle to understand user emotions and provide empathetic feedback. This study integrates emotional intelligence technology into…

Artificial Intelligence · Computer Science 2024-04-30 Jin Wang , JinFei Wang , Shuying Dai , Jiqiang Yu , Keqin Li

Detecting miscommunication in human-robot interaction is a critical function for maintaining user engagement and trust. While humans effortlessly detect communication errors in conversations through both verbal and non-verbal cues, robots…

Robotics · Computer Science 2025-06-26 Ruben Janssens , Jens De Bock , Sofie Labat , Eva Verhelst , Veronique Hoste , Tony Belpaeme

The number of robots deployed in our daily surroundings is ever-increasing. Even in the industrial set-up, the use of coworker robots is increasing rapidly. These cohabitant robots perform various tasks as instructed by co-located human…

Robotics · Computer Science 2020-09-01 Pradip Pramanick , Chayan Sarkar , Indrajit Bhattacharya

As robots become increasingly integrated into various industries, understanding how humans respond to robotic failures is critical. This study systematically examines trust dynamics and system design by analyzing human reactions to robot…

Robotics · Computer Science 2025-05-08 Ponkoj Chandra Shill , Md. Azizul Hakim

Collaborative manipulation is inherently multimodal, with haptic communication playing a central role. When performed by humans, it involves back-and-forth force exchanges between the participants through which they resolve possible…

Robotics · Computer Science 2023-08-21 Zhanibek Rysbek , Ki Hwan Oh , Milos Zefran

In this work, we propose a gesture based language to allow humans to interact with robots using their body in a natural way. We have created a new gesture detection model using neural networks and a custom dataset of humans performing a set…

Robotics · Computer Science 2022-06-16 Javier Laplaza , Joan Jaume Oliver , Ramón Romero , Alberto Sanfeliu , Anaís Garrell

Embodied robots which can interact with their environment and neighbours are increasingly being used as a test case to develop Artificial Intelligence. This creates a need for multimodal robot controllers that can operate across different…

Robotics · Computer Science 2025-02-05 William Hunt , Sarvapali D. Ramchurn , Mohammad D. Soorati

Emotion detection from faces is one of the machine learning problems needed for human-computer interaction. The variety of methods used is enormous, which motivated an in-depth review of articles and scientific studies. Three of the most…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Aleksandra Jamróz , Patrycja Wysocka , Piotr Garbat

Addressing the global caregiver shortage through socially assistive robots necessitates a deep understanding of their psychological and physiological impacts on older adults during human-robot interaction (HRI). This study addresses whether…

This study investigates the integration of individual human traits into an empathetically adaptive educational robot tutor system designed to improve student engagement and learning outcomes with corresponding Engagement Vector measurement.…

Robotics · Computer Science 2025-08-20 Fuze Sun , Lingyu Li , Shixiangyue Meng , Xiaoming Teng , Terry R. Payne , Paul Craig

Recent work in Human-Robot Interaction (HRI) has shown that robots can leverage implicit communicative signals from users to understand how they are being perceived during interactions. For example, these signals can be gaze patterns,…