English
Related papers

Related papers: Language-Grounded Control for Coordinated Robot Mo…

200 papers

Robots are becoming increasingly omnipresent in our daily lives, supporting us and carrying out autonomous tasks. In Human-Robot Interaction, human actors benefit from understanding the robot's motion intent to avoid task failures and…

Human-Computer Interaction · Computer Science 2023-08-09 Max Pascher , Uwe Gruenefeld , Stefan Schneegass , Jens Gerken

The number of robots deployed in our daily surroundings is ever-increasing. Even in the industrial set-up, the use of coworker robots is increasing rapidly. These cohabitant robots perform various tasks as instructed by co-located human…

Robotics · Computer Science 2020-09-01 Pradip Pramanick , Chayan Sarkar , Indrajit Bhattacharya

Natural language understanding for robotics can require substantial domain- and platform-specific engineering. For example, for mobile robots to pick-and-place objects in an environment to satisfy human commands, we can specify the language…

This paper demonstrates the groundwork for the structure and nature of Human-Robot Cognitive Coupling.The human mind is best at associating objects, while digital devices can only compare. Successful communication between robot and human…

Robotics · Computer Science 2018-01-30 Yusuke Inoune , Agunar Prayit

In this paper, we propose an inverse-kinematics controller for a class of multi-robot systems in the scenario of sampled communication. The goal is to make a group of robots perform trajectory tracking in a coordinated way when the sampling…

Robotics · Computer Science 2025-02-11 Enrica Rossi , Marco Tognon , Luca Ballotta , Ruggero Carli , Juan Cortés , Antonio Franchi , Luca Schenato

As social robots see increasing deployment within the general public, improving the interaction with those robots is essential. Spoken language offers an intuitive interface for the human-robot interaction (HRI), with dialogue management…

Robotics · Computer Science 2025-02-04 Merle M. Reimann , Florian A. Kunneman , Catharine Oertel , Koen V. Hindriks

The need for customizable properties in autonomous robotic platforms, such as in-home nursing care for the elderly and parallel implementations of human-to-machine control interfaces creates an opportunity to introduce methods deploying…

Human-Computer Interaction · Computer Science 2014-09-09 Christopher A. Tucker

Planning and execution of agile locomotion maneuvers have been a longstanding challenge in legged robotics. It requires to derive motion plans and local feedback policies in real-time to handle the nonholonomy of the kinetic momenta. To…

Robot navigation methods allow mobile robots to operate in applications such as warehouses or hospitals. While the environment in which the robot operates imposes requirements on its navigation behavior, most existing methods do not allow…

Humans possess a unified cognitive ability to perceive, comprehend, and interact with the physical world. Why can't large language models replicate this holistic understanding? Through a systematic analysis of existing training paradigms in…

Robots are required to autonomously respond to changing situations. Imitation learning is a promising candidate for achieving generalization performance, and extensive results have been demonstrated in object manipulation. However,…

Robotics · Computer Science 2021-01-21 Ayumu Sasagawa , Kazuki Fujimoto , Sho Sakaino , Toshiaki Tsuji

While social robots are developed to provide assistance to users through social interactions, their behaviors are dominantly pre-programmed and remote-controlled. Despite the numerous robot control architectures being developed, very few…

A motion-based control interface promises flexible robot operations in dangerous environments by combining user intuitions with the robot's motor capabilities. However, designing a motion interface for non-humanoid robots, such as…

Robotics · Computer Science 2022-04-29 Sunwoo Kim , Maks Sorokin , Jehee Lee , Sehoon Ha

Bridging the gap between natural language commands and autonomous execution in unstructured environments remains an open challenge for robotics. This requires robots to perceive and reason over the current task scene through multiple…

Robotics · Computer Science 2025-12-23 Jin Wang , Kim Tien Ly , Jacques Cloete , Nikos Tsagarakis , Ioannis Havoutis

Today, as seen in smart speakers, spoken dialogue technology is rapidly advancing to enable human-like interaction. However, current dialogue systems cannot pay attention not only to the content of speech, but also to the way of speaking…

Robotics · Computer Science 2022-10-20 Koki Inoue , Shuichiro Ogake , Hayato Kawamura , Naoki Igo

Cooperation among humans makes it easy to execute tasks and navigate seamlessly even in unknown scenarios. With our individual knowledge and collective cognition skills, we can reason about and perform well in unforeseen situations and…

Robotics · Computer Science 2021-08-17 Gourav Kumar , Soumyadip Maity , Ruddra dev Roychoudhury , Brojeshwar Bhowmick

In robot-assisted therapy for individuals with Autism Spectrum Disorder, the workload of therapists during a therapeutic session is increased if they have to control the robot manually. To allow therapists to focus on the interaction with…

Robotics · Computer Science 2022-07-26 Michał Stolarz , Alex Mitrevski , Mohammad Wasil , Paul G. Plöger

Robotic commands in natural language usually contain various spatial descriptions that are semantically similar but syntactically different. Mapping such syntactic variants into semantic concepts that can be understood by robots is…

Computation and Language · Computer Science 2016-11-02 Junjie Hu , Jean Oh , Anatole Gershman

Human robot collaboration is becoming increasingly important as robots become more involved in various aspects of human life in the era of Artificial Intelligence. However, the issue of human operators trust in robots remains a significant…

Robotics · Computer Science 2023-04-26 Yang Ye , Hengxu You , Jing Du

Recent advancements in language models have demonstrated their adeptness in conducting multi-turn dialogues and retaining conversational context. However, this proficiency remains largely unexplored in other multimodal generative models,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Biao Jiang , Xin Chen , Chi Zhang , Fukun Yin , Zhuoyuan Li , Gang YU , Jiayuan Fan