English
Related papers

Related papers: ExpressMM: Expressive Mobile Manipulation Behavior…

200 papers

In real-world industrial environments, modern robots often rely on human operators for crucial decision-making and mission synthesis from individual tasks. Effective and safe collaboration between humans and robots requires systems that can…

Robotics · Computer Science 2024-06-26 Mike Allenspach , Michael Pantic , Rik Girod , Lionel Ott , Roland Siegwart

Humanoid robots must adapt their contact behavior to diverse objects and tasks, yet most controllers rely on fixed, hand-tuned impedance gains and gripper settings. This paper introduces HumanoidVLM, a vision-language driven retrieval…

Robotics · Computer Science 2026-01-22 Yara Mahmoud , Yasheerah Yaqoot , Miguel Altamirano Cabrera , Dzmitry Tsetserukou

Modeling expressive cross-modal interactions seems crucial in multimodal tasks, such as visual question answering. However, sometimes high-performing black-box algorithms turn out to be mostly exploiting unimodal signals in the data. We…

Computation and Language · Computer Science 2020-10-14 Jack Hessel , Lillian Lee

Emotion expressions serve as important communicative signals and are crucial cues in intuitive interactions between humans. Hence, it is essential to include these fundamentals in robotic behavior strategies when interacting with humans to…

Robotics · Computer Science 2023-11-08 Thorsten Hempel , Laslo Dinges , Ayoub Al-Hamadi

This paper presents an overview of robot failure detection work from HRI and adjacent fields using failures as an opportunity to examine robot explanation behaviours. As humanoid robots remain experimental tools in the early 2020s,…

Human-Computer Interaction · Computer Science 2023-07-11 Dimosthenis Kontogiorgos

Multi-robot systems hold significant promise for social environments such as homes and hospitals, yet existing multi-robot works treat robots as functionally identical, overlooking how robots individual identity shape user perception and…

Robotics · Computer Science 2026-04-15 Shaid Hasan , Breenice Lee , Sujan Sarker , Tariq Iqbal

The field of Augmented Reality (AR) based Human Robot Interaction (HRI) has progressed significantly since its inception more than two decades ago. With more advanced devices, particularly head-mounted displays (HMD), freely available…

Robotics · Computer Science 2019-10-11 David Puljiz , Björn Hein

In robotics, many control and planning schemes have been developed to ensure human physical safety in human-robot interaction. The human psychological state and the expectation towards the robot, however, are typically neglected. Even if…

Robotics · Computer Science 2024-08-20 Robin Jeanne Kirschner , Henning Mayer , Lisa Burr , Nico Mansfeld , Saeed Abdolshah , Sami Haddadin

Developing robots that can assist humans efficiently, safely, and adaptively is crucial for real-world applications such as healthcare. While previous work often assumes a centralized system for co-optimizing human-robot interactions, we…

Robotics · Computer Science 2024-12-30 Jason Qin , Shikun Ban , Wentao Zhu , Yizhou Wang , Dimitris Samaras

A challenge in using robots in human-inhabited environments is to design behavior that is engaging, yet robust to the perturbations induced by human interaction. Our idea is to imbue the robot with intrinsic motivation (IM) so that it can…

Robotics · Computer Science 2022-03-03 Marcus M. Scheunemann , Christoph Salge , Daniel Polani , Kerstin Dautenhahn

Automated vehicles lack natural communication channels with other road users, making external Human-Machine Interfaces (eHMIs) essential for conveying intent and maintaining trust in shared environments. However, most eHMI studies rely on…

Human-Computer Interaction · Computer Science 2026-04-22 Ding Xia , Xinyue Gui , Mark Colley , Fan Gao , Zhongyi Zhou , Dongyuan Li , Renhe Jiang , Takeo Igarashi

Multi-robot collaboration tasks often require heterogeneous robots to work together over long horizons under spatial constraints and environmental uncertainties. Although Large Language Models (LLMs) excel at reasoning and planning, their…

Robotics · Computer Science 2026-02-10 Siqi Song , Xuanbing Xie , Zonglin Li , Yuqiang Li , Shijie Wang , Biqing Qi

Teaching robots novel behaviors typically requires motion demonstrations via teleoperation or kinaesthetic teaching, that is, physically guiding the robot. While recent work has explored using human sketches to specify desired behaviors,…

Robotics · Computer Science 2025-09-26 William Barron , Xiaoxiang Dong , Matthew Johnson-Roberson , Weiming Zhi

In order to address the limitations of gestural capabilities in physical robots, researchers in Virtual, Augmented, Mixed Reality Human-Robot Interaction (VAM-HRI) have been using augmented-reality visualizations that increase robot…

Robotics · Computer Science 2022-05-16 Ipek Goktan , Karen Ly , Thomas R. Groechel , Maja J. Mataric

Human-in-the-loop approaches are of great importance for robot applications. In the presented study, we implemented a multimodal human-robot interaction (HRI) scenario, in which a simulated robot communicates with its human partner through…

Robotics · Computer Science 2024-03-14 Su Kyoung Kim , Michael Maurus , Mathias Trampler , Marc Tabie , Elsa Andrea Kirchner

We investigate the use of Large Language Models (LLMs) to equip neural robotic agents with human-like social and cognitive competencies, for the purpose of open-ended human-robot conversation and collaboration. We introduce a modular and…

Robotics · Computer Science 2024-09-30 Philipp Allgeuer , Hassan Ali , Stefan Wermter

Human collaborators coordinate effectively their actions through both verbal and non-verbal communication. We believe that the the same should hold for human-robot teams. We propose a formalism that enables a robot to decide optimally…

Robotics · Computer Science 2017-06-16 Stefanos Nikolaidis , Minae Kwon , Jodi Forlizzi , Siddhartha Srinivasa

The rapid progress of vision--language models (VLMs) has sparked growing interest in robotic control, where natural language can express the operation goals while visual feedback links perception to action. However, directly deploying…

Robotics · Computer Science 2025-11-04 Sarthak Mishra , Rishabh Dev Yadav , Avirup Das , Saksham Gupta , Wei Pan , Spandan Roy

Collaborative manipulation is inherently multimodal, with haptic communication playing a central role. When performed by humans, it involves back-and-forth force exchanges between the participants through which they resolve possible…

Robotics · Computer Science 2023-08-21 Zhanibek Rysbek , Ki Hwan Oh , Milos Zefran

With the advances in robotic technology, research in human-robot collaboration (HRC) has gained in importance. For robots to interact with humans autonomously they need active decision making that takes human partners into account. However,…

Robotics · Computer Science 2017-05-30 Judith Bütepage , Danica Kragic