English
Related papers

Related papers: Talking with Robots: Opportunities and Challenges

200 papers

The integration of artificial intelligence, especially large language models in robotics, has led to rapid advancements in the field. We are now observing an unprecedented surge in the use of robots in our daily lives. The development and…

Robotics · Computer Science 2024-09-17 Diba Afroze , Yazhou Tu , Xiali Hei

We are developing a system for human-robot communication that enables people to communicate with robots in a natural way and is focused on solving problems in a shared space. Our strategy for developing this system is fundamentally…

Human-Computer Interaction · Computer Science 2017-10-03 Michael Wollowski , Carlotta Berry , Ryder Winck , Alan Jern , David Voltmer , Alan Chiu , Yosi Shibberu

Recently, research in human-robot interaction began to consider a robot's influence at the group level. Despite the recent growth in research investigating the effects of robots within groups of people, our overall understanding of what…

Human-Computer Interaction · Computer Science 2023-12-22 Tung Nguyen , Eric Nichols , Randy Gomez

As social robots see increasing deployment within the general public, improving the interaction with those robots is essential. Spoken language offers an intuitive interface for the human-robot interaction (HRI), with dialogue management…

Robotics · Computer Science 2025-02-04 Merle M. Reimann , Florian A. Kunneman , Catharine Oertel , Koen V. Hindriks

Speech is a natural interface for humans to interact with robots. Yet, aligning a robot's voice to its appearance is challenging due to the rich vocabulary of both modalities. Previous research has explored a few labels to describe robots…

Human-Computer Interaction · Computer Science 2024-02-09 Pol van Rijn , Silvan Mertes , Kathrin Janowski , Katharina Weitz , Nori Jacoby , Elisabeth André

Purpose of Review. This review summarizes the broad roles that communication formats and technologies have played in enabling multi-robot systems. We approach this field from two perspectives: of robotic applications that need communication…

Robotics · Computer Science 2022-06-22 Jennifer Gielis , Ajay Shankar , Amanda Prorok

A long-term goal of Artificial Intelligence is to build a language understanding system that allows a human to collaborate with a physical robot using language that is natural to the human. In this paper we highlight some of the challenges…

Neurons and Cognition · Quantitative Biology 2025-06-24 Peter Lindes , Kaoutar Skiker

Recent advancements have enabled human-robot collaboration through physical assistance and verbal guidance. However, limitations persist in coordinating robots' physical motions and speech in response to real-time changes in human behavior…

Robotics · Computer Science 2023-10-11 Ravi Tejwani , Chengyuan Ma , Paco Gomez-Paz , Paolo Bonato , H. Harry Asada

In recent years, artificial intelligence has developed in a variety of fields and is now integrated into many aspects of our daily lives. This includes AI speakers,communication robots, and other interactive systems. We are interested in AI…

Computation · Statistics 2022-10-20 Goro Miyano , Kotaro Matsuo , Tomohiro , Kawatsu , Ibuki Unno , Kisumi Shibata , Mitsuki Fumoto

Robotic agents that share autonomy with a human should leverage human domain knowledge and account for their preferences when completing a task. This extra knowledge can dramatically improve plan efficiency and user-satisfaction, but these…

Robotics · Computer Science 2018-05-22 Rosario Scalise , Yonatan Bisk , Maxwell Forbes , Daqing Yi , Yejin Choi , Siddhartha Srinivasa

Humanoid robots have apparently similar body structure like human beings. Due to their technical design, they are sharing the same workspace with humans. They are placed to clean things, to assist old age people, to entertain us and most…

Human-Computer Interaction · Computer Science 2018-11-20 Neha Baranwal

This paper identifies stylistic differences in instruction-giving observed in a corpus of human-robot dialogue. Differences in verbosity and structure (i.e., single-intent vs. multi-intent instructions) arose naturally without restrictions…

Computation and Language · Computer Science 2018-07-24 Stephanie M. Lukin , Kimberly A. Pollard , Claire Bonial , Matthew Marge , Cassidy Henry , Ron Arstein , David Traum , Clare R. Voss

In spoken dialogue systems, we aim to deploy artificial intelligence to build automated dialogue agents that can converse with humans. Dialogue systems are increasingly being designed to move beyond just imitating conversation and also…

Computation and Language · Computer Science 2021-11-03 Atharv Singh Patlan , Shiven Tripathi , Shubham Korde

We investigate the use of Large Language Models (LLMs) to equip neural robotic agents with human-like social and cognitive competencies, for the purpose of open-ended human-robot conversation and collaboration. We introduce a modular and…

Robotics · Computer Science 2024-09-30 Philipp Allgeuer , Hassan Ali , Stefan Wermter

As AI is increasingly being adopted into application solutions, the challenge of supporting interaction with humans is becoming more apparent. Partly this is to support integrated working styles, in which humans and intelligent systems…

Artificial Intelligence · Computer Science 2017-10-02 Maria Fox , Derek Long , Daniele Magazzeni

The new industrial settings are characterized by the presence of human and robots that work in close proximity, cooperating in performing the required job. Such a collaboration, however, requires to pay attention to many aspects. Firstly,…

Robotics · Computer Science 2024-09-12 Davide Ferrari , Andrea Pupa , Alberto Signoretti , Cristian Secchi

For robots to seamlessly interact with humans, we first need to make sure that humans and robots understand one another. Diverse algorithms have been developed to enable robots to learn from humans (i.e., transferring information from…

Robotics · Computer Science 2023-12-05 Soheil Habibian , Antonio Alvarez Valdivia , Laura H. Blumenschein , Dylan P. Losey

In this paper, we describe the development of symbolic representations annotated on human-robot dialogue data to make dimensions of meaning accessible to autonomous systems participating in collaborative, natural language dialogue, and to…

Efforts towards endowing robots with the ability to speak have benefited from recent advancements in natural language processing, in particular large language models. However, current language models are not fully incremental, as their…

Computation and Language · Computer Science 2025-04-03 Casey Kennington , Pierre Lison , David Schlangen

With an increasing need for elderly and disability care, there is an increasing opportunity for intelligent and mobile devices such as robots to provide care and support solutions. In order to naturally assist and interact with humans, a…

Robotics · Computer Science 2020-12-24 Katsushi Ikeuchi , David Baumert , Shunsuke Kudoh , Masaru Takizawa