English
Related papers

Related papers: Developing Social Robots with Empathetic Non-Verba…

200 papers

Incorporating empathetic behavior into robots can improve their social effectiveness and interaction quality. In this paper, we present whEE (when and how to express empathy), a framework that enables social robots to detect when empathy is…

Robotics · Computer Science 2025-10-01 Christian Arzate Cruz , Edwin C. Montiel-Vazquez , Chikara Maeda , Randy Gomez

Nonverbal visual symbols and displays play an important role in communication when humans and robots work collaboratively. However, few studies have investigated how different types of non-verbal cues affect objective task performance,…

Robotics · Computer Science 2025-12-15 Matthew Ebisu , Hang Yu , Reuben Aronson , Elaine Short

Recognition of social signals, from human facial expressions or prosody of speech, is a popular research topic in human-robot interaction studies. There is also a long line of research in the spoken dialogue community that investigates user…

Robotics · Computer Science 2017-06-12 Jekaterina Novikova , Christian Dondrup , Ioannis Papaioannou , Oliver Lemon

Large Language Models (LLMs) have demonstrated remarkable performance across various information-seeking and reasoning tasks. These computational systems drive state-of-the-art dialogue systems, such as ChatGPT and Bard. They also carry…

Computation and Language · Computer Science 2023-10-13 Siyuan Brandon Loh , Aravind Sesagiri Raamkumar

Emotion expressions serve as important communicative signals and are crucial cues in intuitive interactions between humans. Hence, it is essential to include these fundamentals in robotic behavior strategies when interacting with humans to…

Robotics · Computer Science 2023-11-08 Thorsten Hempel , Laslo Dinges , Ayoub Al-Hamadi

We are approaching a future where social robots will progressively become widespread in many aspects of our daily lives, including education, healthcare, work, and personal use. All of such practical applications require that humans and…

Artificial Intelligence · Computer Science 2021-10-19 Nguyen Tan Viet Tuyen , Oya Celiktutan

In this paper we present a pilot study which investigates how non-verbal behavior affects social influence in social robots. We also present a modular system which is capable of controlling the non-verbal behavior based on the…

Robotics · Computer Science 2021-09-06 Patrik Jonell , Anna Deichler , Ilaria Torre , Iolanda Leite , Jonas Beskow

Large Language Models (LLMs) have demonstrated surprising performance on many tasks, including writing supportive messages that display empathy. Here, we had these models generate empathic messages in response to posts describing common…

Computation and Language · Computer Science 2024-03-28 Yoon Kyung Lee , Jina Suh , Hongli Zhan , Junyi Jessy Li , Desmond C. Ong

Nonverbal behaviors, particularly gaze direction, play a crucial role in enhancing effective communication in social interactions. As social robots increasingly participate in these interactions, they must adapt their gaze based on human…

Robotics · Computer Science 2026-02-13 Faezeh Vahedi , Morteza Memari , Ramtin Tabatabaei , Alireza Taheri

Human intention-based systems enable robots to perceive and interpret user actions to interact with humans and adapt to their behavior proactively. Therefore, intention prediction is pivotal in creating a natural interaction with social…

Robotics · Computer Science 2025-04-09 Hassan Ali , Philipp Allgeuer , Stefan Wermter

Humanoid social robots are increasingly present in daily life, making sustained user engagement a critical factor for their effectiveness and acceptance. While prior work has often examined affective evaluations or anthropomorphic design,…

Human-Computer Interaction · Computer Science 2026-02-11 Hangyeol Kang , Thiago Freitas dos Santos , Maher Ben Moussa , Nadia Magnenat-Thalmann

Conventional behavior cloning (BC) models often struggle to replicate the subtleties of human actions. Previous studies have attempted to address this issue through the development of a new BC technique: Implicit Behavior Cloning (IBC).…

Robotics · Computer Science 2025-01-22 Antonio Lech Martin-Ozimek , Isuru Jayarathne , Su Larb Mon , Jouhyeong Chew

In human-robot interaction (HRI), the beginning of an interaction is often complex. Whether the robot should communicate with the human is dependent on several situational factors (e.g., the current human's activity, urgency of the…

Human-Computer Interaction · Computer Science 2025-03-21 Kazuhiro Sasabuchi , Naoki Wake , Atsushi Kanehira , Jun Takamatsu , Katsushi Ikeuchi

This paper presents an innovative large language model (LLM)-based robotic system for enhancing multi-modal human-robot interaction (HRI). Traditional HRI systems relied on complex designs for intent estimation, reasoning, and behavior…

The demand for social robots in fields like healthcare, education, and entertainment increases due to their emotional adaptation features. These robots leverage multimodal communication, incorporating speech, facial expressions, and…

Robotics · Computer Science 2024-07-31 Rita Frieske , Xiaoyu Mo , Yini Fang , Jay Nieles , Bertram E. Shi

Large language models (LLMs) enable increasingly capable tutoring-style conversational agents, yet effective tutoring requires sensitivity to learners' affective and cognitive states beyond text alone. Facial expressions provide immediate…

Human-Computer Interaction · Computer Science 2026-04-20 Shuangquan Feng , Laura Fleig , Ruisen Tu , Philip Chi , Edmund Bu , Melinda Ozel , Junhua Ma , Teng Fei , Virginia R. de Sa

Natural-language dialog is key for intuitive human-robot interaction. It can be used not only to express humans' intents, but also to communicate instructions for improvement if a robot does not understand a command correctly. Of great…

Robotics · Computer Science 2024-10-14 Leonard Bärmann , Rainer Kartmann , Fabian Peller-Konrad , Jan Niehues , Alex Waibel , Tamim Asfour

Large language models have given social robots the ability to autonomously engage in open-domain conversations. However, they are still missing a fundamental social skill: making use of the multiple modalities that carry social…

Robotics · Computer Science 2025-08-19 Ruben Janssens , Tony Belpaeme

Effective human-robot collaboration hinges on robust communication channels, with visual signaling playing a pivotal role due to its intuitive appeal. Yet, the creation of visually intuitive cues often demands extensive resources and…

Robotics · Computer Science 2024-09-24 Shubham Sonawani , Fabian Weigend , Heni Ben Amor

In recent years, autonomous agents have surged in real-world environments such as our homes, offices, and public spaces. However, natural human-robot interaction remains a key challenge. In this paper, we introduce an approach that…

Robotics · Computer Science 2024-10-15 Linus Nwankwo , Elmar Rueckert