English
Related papers

Related papers: Towards Language-Based Modulation of Assistive Rob…

200 papers

We investigate the use of Large Language Models (LLMs) to equip neural robotic agents with human-like social and cognitive competencies, for the purpose of open-ended human-robot conversation and collaboration. We introduce a modular and…

Robotics · Computer Science 2024-09-30 Philipp Allgeuer , Hassan Ali , Stefan Wermter

The new industrial settings are characterized by the presence of human and robots that work in close proximity, cooperating in performing the required job. Such a collaboration, however, requires to pay attention to many aspects. Firstly,…

Robotics · Computer Science 2024-09-12 Davide Ferrari , Andrea Pupa , Alberto Signoretti , Cristian Secchi

In the rapidly evolving landscape of human-robot collaboration, effective communication between humans and robots is crucial for complex task execution. Traditional request-response systems often lack naturalness and may hinder efficiency.…

Robotics · Computer Science 2024-09-12 Davide Ferrari , Filippo Alberi , Cristian Secchi

Robots learn as they interact with humans. Consider a human teleoperating an assistive robot arm: as the human guides and corrects the arm's motion, the robot gathers information about the human's desired task. But how does the human know…

Robotics · Computer Science 2024-04-16 James F. Mullen , Josh Mosier , Sounak Chakrabarti , Anqi Chen , Tyler White , Dylan P. Losey

It is important for socially assistive robots to be able to recognize when a user needs and wants help. Such robots need to be able to recognize human needs in a real-time manner so that they can provide timely assistance. We propose an…

Robotics · Computer Science 2021-10-22 Jason R. Wilson , Phyo Thuta Aung , Isabelle Boucher

Developing robots that can assist humans efficiently, safely, and adaptively is crucial for real-world applications such as healthcare. While previous work often assumes a centralized system for co-optimizing human-robot interactions, we…

Robotics · Computer Science 2024-12-30 Jason Qin , Shikun Ban , Wentao Zhu , Yizhou Wang , Dimitris Samaras

With the increasing prevalence and diversity of robots interacting in the real world, there is need for flexible, on-the-fly planning and cooperation. Large Language Models are starting to be explored in a multimodal setup for…

Robotics · Computer Science 2024-03-01 William Hunt , Toby Godfrey , Mohammad D. Soorati

Service robots need to show appropriate social behaviour in order to be deployed in social environments such as healthcare, education, retail, etc. Some of the main capabilities that robots should have are navigation and conversational…

Robotics · Computer Science 2018-11-15 Chandrakant Bothe , Fernando Garcia , Arturo Cruz Maya , Amit Kumar Pandey , Stefan Wermter

As human-robot collaboration is becoming more widespread, there is a need for a more natural way of communicating with the robot. This includes combining data from several modalities together with the context of the situation and background…

Human-Computer Interaction · Computer Science 2024-04-03 Petr Vanc , Radoslav Skoviera , Karla Stepanova

Recently the field of Human-Robot Interaction gained popularity, due to the wide range of possibilities of how robots can support humans during daily tasks. One form of supportive robots are socially assistive robots which are specifically…

Human-Computer Interaction · Computer Science 2023-03-15 Jan Leusmann , Chao Wang , Michael Gienger , Albrecht Schmidt , Sven Mayer

Robots are increasingly common in industry and daily life, such as in nursing homes where they can assist staff. A key challenge is developing intuitive interfaces for easy communication. The use of Large Language Models (LLMs) like GPT-4…

Robotics · Computer Science 2024-08-01 Stanislau Stankevich , Wojciech Dudek

When designing robots to assist in everyday human activities, it is crucial to enhance user requests with visual cues from their surroundings for improved intent understanding. This process is defined as a multimodal classification task.…

Computation and Language · Computer Science 2025-06-18 Shang-Chi Tsai , Seiya Kawano , Angel Garcia Contreras , Koichiro Yoshino , Yun-Nung Chen

Effective physical human-robot interaction requires systems that are not only adaptable to user preferences but also transparent about their actions. This paper introduces BRIDGE, a system for bidirectional human-robot communication in…

Robotics · Computer Science 2026-01-19 Junxiang Wang , Cindy Wang , Rana Soltani Zarrin , Zackory Erickson

Humans engaged in collaborative activities are naturally able to convey their intentions to teammates through multi-modal communication, which is made up of explicit and implicit cues. Similarly, a more natural form of human-robot…

Robotics · Computer Science 2022-07-01 Simone Macciò , Alessandro Carfì , Fulvio Mastrogiovanni

This paper explores the challenges faced by assistive robots in effectively cooperating with humans, requiring them to anticipate human behavior, predict their actions' impact, and generate understandable robot actions. The study focuses on…

Robotics · Computer Science 2023-08-22 Chao Wang , Theodoros Stouraitis , Anna Belardinelli , Stephan Hasler , Michael Gienger

Trustworthiness is a crucial concept in the context of human-robot interaction. Cooperative robots must be transparent regarding their decision-making process, especially when operating in a human-oriented environment. This paper presents a…

Robotics · Computer Science 2024-05-07 Tuba Girgin , Emre Girgin , Yigit Yildirim , Emre Ugur , Mehmet Haklidir

Recent development in developing humanoid robot poses new challenges to human-machine interaction communication. A major challenge is to develop robots that can behave like and interact with human in the most natural way possible. This…

Robotics · Computer Science 2014-12-03 Ong Sing Goh , Lance Fung

In a rapidly evolving digital landscape autonomous tools and robots are becoming commonplace. Recognizing the significance of this development, this paper explores the integration of Large Language Models (LLMs) like Generative pre-trained…

Human-Computer Interaction · Computer Science 2024-03-22 Younes Lakhnati , Max Pascher , Jens Gerken

Robot assistants for older adults and people with disabilities need to interact with their users in collaborative tasks. The core component of these systems is an interaction manager whose job is to observe and assess the task, and infer…

Natural language is the most intuitive medium for us to interact with other people when expressing commands and instructions. However, using language is seldom an easy task when humans need to express their intent towards robots, since most…

Robotics · Computer Science 2022-03-28 Arthur Bucker , Luis Figueredo , Sami Haddadin , Ashish Kapoor , Shuang Ma , Rogerio Bonatti