English
Related papers

Related papers: LLM-Driven Augmented Reality Puppeteer: Controller…

200 papers

Robotic teleoperation is a key technology for a wide variety of applications. It allows sending robots instead of humans in remote, possibly dangerous locations while still using the human brain with its enormous knowledge and creativity,…

Robotics · Computer Science 2021-09-29 Christian Lenz , Sven Behnke

This work introduces a solution to enhance human-robot interaction over limited wireless connectivity. The goal is toenable remote control of a robot through a virtual reality (VR)interface, ensuring a smooth transition to autonomous mode…

Robotics · Computer Science 2024-06-26 H. P. Madushanka , Rafaela Scaciota , Sumudu Samarakoon , Mehdi Bennis

ffective Human-Robot Interaction (HRI) is crucial for enhancing accessibility and usability in real-world robotics applications. However, existing solutions often rely on gesture- only or language-only commands, making interaction…

Human-Computer Interaction · Computer Science 2026-05-19 Yuzhi Lai , Shenghai Yuan , Peizheng Li , Boya Zhang , Benjamin Kiefer , Tianchen Deng , Andreas Zell

Assistive robots have attracted significant attention due to their potential to enhance the quality of life for vulnerable individuals like the elderly. The convergence of computer vision, large language models, and robotics has introduced…

Robotics · Computer Science 2024-06-24 Peng Wang , Mattia Robbiani , Zhihao Guo

Human-robot collaboration aims to extend human ability through cooperation with robots. This technology is currently helping people with physical disabilities, has transformed the manufacturing process of companies, improved surgical…

Robotics · Computer Science 2026-03-10 Xiangjie Yan , Chen Chen , Xiang Li

The socially-aware navigation system has evolved to adeptly avoid various obstacles while performing multiple tasks, such as point-to-point navigation, human-following, and -guiding. However, a prominent gap persists: in Human-Robot…

Robotics · Computer Science 2024-03-22 Weiqin Zu , Wenbin Song , Ruiqing Chen , Ze Guo , Fanglei Sun , Zheng Tian , Wei Pan , Jun Wang

This paper introduces a system designed to generate explanations for the actions performed by an autonomous robot in Human-Robot Interaction (HRI). Explainability in robotics, encapsulated within the concept of an eXplainable Autonomous…

Advances in artificial intelligence and human-computer interaction will likely lead to extended reality (XR) becoming pervasive. While XR can provide users with interactive, engaging, and immersive experiences, non-player characters are…

Human-Computer Interaction · Computer Science 2024-06-21 Efe Bozkir , Süleyman Özdel , Ka Hei Carrie Lau , Mengdi Wang , Hong Gao , Enkelejda Kasneci

Robotic avatars promise immersive teleoperation with human-like manipulation and communication capabilities. We present such an avatar system, based on the key components of immersive 3D visualization and transparent force-feedback…

Robotics · Computer Science 2021-09-29 Max Schwarz , Christian Lenz , Andre Rochow , Michael Schreiber , Sven Behnke

Telemanipulation has become a promising technology that combines human intelligence with robotic capabilities to perform tasks remotely. However, it faces several challenges such as insufficient transparency, low immersion, and limited…

Robotics · Computer Science 2025-03-06 Max Grobbel , Balint Varga , Sören Hohmann

The impressive capabilities of Large Language Models (LLMs) have led to various efforts to enable robots to be controlled through natural language instructions, opening exciting possibilities for human-robot interaction The goal is for the…

Robotics · Computer Science 2024-03-19 Seif Ismail , Antonio Arbues , Ryan Cotterell , René Zurbrügg , Carmen Amo Alonso

Even though intelligent systems such as Siri or Google Assistant are enjoyable (and useful) dialog partners, users can only access predefined functionality. Enabling end-users to extend the functionality of intelligent systems will be the…

Computation and Language · Computer Science 2020-09-15 Sebastian Weigelt , Vanessa Steurer , Walter F. Tichy

Researchers are exploring Augmented Reality (AR) interfaces for online robot programming to streamline automation and user interaction in variable manufacturing environments. This study introduces an AR interface for online programming and…

Robotics · Computer Science 2024-06-06 Kaveh Malek , Claus Danielson , Fernando Moreu

The adoption of multimodal interactions by Voice Assistants (VAs) is growing rapidly to enhance human-computer interactions. Smartwatches have now incorporated trigger-less methods of invoking VAs, such as Raise To Speak (RTS), where the…

Robots are becoming increasingly popular in a wide range of environments due to their exceptional work capacity, precision, efficiency, and scalability. This development has been further encouraged by advances in Artificial Intelligence,…

Human-Computer Interaction · Computer Science 2023-12-14 Daniel Weber

Robotics simulation has been an integral part of research and development in the robotics area. The simulation eliminates the possibility of harm to sensors, motors, and the physical structure of a real robot by enabling robotics…

Haptic feedback is essential for humans to successfully perform complex and delicate manipulation tasks. A recent rise in tactile sensors has enabled robots to leverage the sense of touch and expand their capability drastically. However,…

Robotics · Computer Science 2024-03-26 Martina Lippi , Michael C. Welle , Maciej K. Wozniak , Andrea Gasparri , Danica Kragic

Employing a teleoperation system for gathering demonstrations offers the potential for more efficient learning of robot manipulation. However, teleoperating a robot arm equipped with a dexterous hand or gripper, via a teleoperation system…

This paper describes the development of a real-time Human-Robot Interaction (HRI) system for a service robot based on 3D human activity recognition and human-like decision mechanism. The Human-Robot Interactive (HRI) system, which allows…

Human-Computer Interaction · Computer Science 2019-01-14 Kang Li , Jinting Wu , Xiaoguang Zhao , Min Tan

Multi-robot coordination based on large language models (LLMs) has attracted growing attention, since LLMs enable the direct translation of natural language instructions into robot action plans by decomposing tasks and generating high-level…