English
Related papers

Related papers: Few-Shot Visual Grounding for Natural Human-Robot …

200 papers

Translating human intent into robot commands is crucial for the future of service robots in an aging society. Existing Human-Robot Interaction (HRI) systems relying on gestures or verbal commands are impractical for the elderly due to…

The rapid development of Large Language Models (LLMs) creates an exciting potential for flexible, general knowledge-driven Human-Robot Interaction (HRI) systems for assistive robots. Existing HRI systems demonstrate great progress in…

Robotics · Computer Science 2025-07-22 Jens V. Rüppel , Andrey Rudenko , Tim Schreiter , Martin Magnusson , Achim J. Lilienthal

Robotic vision plays a key role for perceiving the environment in grasping applications. However, the conventional framed-based robotic vision, suffering from motion blur and low sampling rate, may not meet the automation needs of evolving…

When a robot performs a task next to a human, physical interaction is inevitable: the human might push, pull, twist, or guide the robot. The state-of-the-art treats these interactions as disturbances that the robot should reject or avoid.…

Robotics · Computer Science 2021-07-07 Dylan P. Losey , Andrea Bajcsy , Marcia K. O'Malley , Anca D. Dragan

Interpreting human intent accurately is a central challenge in human-robot interaction (HRI) and a key requirement for achieving more natural and intuitive collaboration between humans and machines. This work presents a novel multimodal HRI…

Robotics · Computer Science 2026-02-25 Guanting Shen , Zi Tian

As of today, robots exhibit impressive agility but also pose potential hazards to humans using/collaborating with them. Consequently, safety is considered the most paramount factor in human-robot interaction (HRI). This paper presents a…

The field of Augmented Reality (AR) based Human Robot Interaction (HRI) has progressed significantly since its inception more than two decades ago. With more advanced devices, particularly head-mounted displays (HMD), freely available…

Robotics · Computer Science 2019-10-11 David Puljiz , Björn Hein

We explore new aspects of assistive living on smart human-robot interaction (HRI) that involve automatic recognition and online validation of speech and gestures in a natural interface, providing social features for HRI. We introduce a…

Multimedia · Computer Science 2017-11-07 A. Zlatintsi , I. Rodomagoulakis , P. Koutras , A. C. Dometios , V. Pitsikalis , C. S. Tzafestas , P. Maragos

Proactive human-robot interaction (HRI) allows the receptionist robots to actively greet people and offer services based on vision, which has been found to improve acceptability and customer satisfaction. Existing approaches are either…

Robotics · Computer Science 2021-03-25 Yang Xue , Fan Wang , Hao Tian , Min Zhao , Jiangyong Li , Haiqing Pan , Yueqiang Dong

Close human-robot interaction (HRI), especially in industrial scenarios, has been vastly investigated for the advantages of combining human and robot skills. For an effective HRI, the validity of currently available human-machine…

Robots are becoming increasingly popular in a wide range of environments due to their exceptional work capacity, precision, efficiency, and scalability. This development has been further encouraged by advances in Artificial Intelligence,…

Human-Computer Interaction · Computer Science 2023-12-14 Daniel Weber

In recent years, the demand for social robots has grown, requiring them to adapt their behaviors based on users' states. Accurately assessing user experience (UX) in human-robot interaction (HRI) is crucial for achieving this adaptability.…

Robotics · Computer Science 2025-08-01 Ryo Miyoshi , Yuki Okafuji , Takuya Iwamoto , Junya Nakanishi , Jun Baba

Human-Robot Interaction (HRI) is an emerging subfield of service robotics. While most existing approaches rely on explicit signals (i.e. voice, gesture) to engage, current literature is lacking solutions to address implicit user needs. In…

Artificial Intelligence · Computer Science 2022-02-24 Maëlic Neau , Paulo Santos , Anne-Gwenn Bosser , Nathan Beu , Cédric Buche

The use of social, anthropomorphic robots to support humans in various industries has been on the rise. During Human-Robot Interaction (HRI), physically interactive non-verbal behaviour is key for more natural interactions. Handshaking is…

Robotics · Computer Science 2020-11-20 Vignesh Prasad , Ruth Stock-Homburg , Jan Peters

Communication between people is characterized by a broad range of nonverbal cues. Transferring these cues into the design of robots and other artificial agents that interact with people may foster more natural, inviting, and accessible…

Robotics · Computer Science 2023-04-25 Jacqueline Urakami , Katie Seaborn

Zero-shot Human-Object Interaction detection aims to localize humans and objects in an image and recognize their interaction, even when specific verb-object pairs are unseen during training. Recent works have shown promising results using…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Chanhyeong Yang , Taehoon Song , Jihwan Park , Hyunwoo J. Kim

This abstract explores classroom Human-Robot Interaction (HRI) scenarios with an emphasis on the adaptation of human-inspired social gaze models in robot cognitive architecture to facilitate a more seamless social interaction. First, we…

Robotics · Computer Science 2024-02-06 Sahand Shaghaghi , Pourya Aliasghari , Bryan Tripp , Kerstin Dautenhahn , Chrystopher Nehaniv

Natural Human-Robot Interaction (N-HRI) requires robots to recognize human actions at varying distances and states, regardless of whether the robot itself is in motion or stationary. This setup is more flexible and practical than…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Ziyi Wang , Peiming Li , Hong Liu , Zhichao Deng , Can Wang , Jun Liu , Junsong Yuan , Mengyuan Liu

To facilitate human--robot interaction (HRI) tasks in real-world scenarios, service robots must adapt to dynamic environments and understand the required tasks while effectively communicating with humans. To accomplish HRI in practice, we…

Robotics · Computer Science 2024-12-19 Yuga Yano , Akinobu Mizutani , Yukiya Fukuda , Daiju Kanaoka , Tomohiro Ono , Hakaru Tamukoh

Generalization to unseen tasks is an important ability for few-shot learners to achieve better zero-/few-shot performance on diverse tasks. However, such generalization to vision-language tasks including grounding and generation tasks has…

Computation and Language · Computer Science 2023-05-25 Woojeong Jin , Subhabrata Mukherjee , Yu Cheng , Yelong Shen , Weizhu Chen , Ahmed Hassan Awadallah , Damien Jose , Xiang Ren