English
Related papers

Related papers: Open Challenges on Generating Referring Expression…

200 papers

The new industrial settings are characterized by the presence of human and robots that work in close proximity, cooperating in performing the required job. Such a collaboration, however, requires to pay attention to many aspects. Firstly,…

Robotics · Computer Science 2024-09-12 Davide Ferrari , Andrea Pupa , Alberto Signoretti , Cristian Secchi

To enable robots to instruct humans in collaborations, we identify several aspects of language processing that are not commonly studied in this context. These include location, planning, and generation. We suggest evaluations for each task,…

Artificial Intelligence · Computer Science 2021-10-12 Seth Pate , Wei Xu , Ziyi Yang , Maxwell Love , Siddarth Ganguri , Lawson L. S. Wong

In the field of Human-Robot Interaction (HRI), many researchers study shared control systems. Shared control is when a person and agent both contribute to the performance of a task in a collaborative way, often by providing control inputs…

Robotics · Computer Science 2022-03-22 Sachiko Matsumoto , Laurel D. Riek

Implicit communication is crucial in human-robot collaboration (HRC), where contextual information, such as intentions, is conveyed as implicatures, forming a natural part of human interaction. However, enabling robots to appropriately use…

Robotics · Computer Science 2025-02-11 Yan Zhang

Facial expressions are an ideal means of communicating one's emotions or intentions to others. This overview will focus on human facial expression recognition as well as robotic facial expression generation. In the case of human facial…

Robotics · Computer Science 2022-02-09 Niyati Rawal , Ruth Maria Stock-Homburg

Robots can learn preferences from human demonstrations, but their success depends on how informative these demonstrations are. Being informative is unfortunately very challenging, because during teaching, people typically get no…

Robotics · Computer Science 2019-11-07 Sandy H. Huang , Isabella Huang , Ravi Pandya , Anca D. Dragan

This paper presents a research platform that supports spoken dialogue interaction with multiple robots. The demonstration showcases our crafted MultiBot testing scenario in which users can verbally issue search, navigate, and follow…

How can multiple humans interact with multiple robots? The goal of our research is to create an effective interface that allows multiple operators to collaboratively control teams of robots in complex tasks. In this paper, we focus on a key…

Robotics · Computer Science 2021-02-02 Jayam Patel , Tyagaraja Ramaswamy , Zhi Li , Carlo Pinciroli

Voice-based communication is often cited as one of the most `natural' ways in which humans and robots might interact, and the recent availability of accurate automatic speech recognition and intelligible speech synthesis has enabled…

Robotics · Computer Science 2022-03-17 Roger K. Moore

Emotion expressions serve as important communicative signals and are crucial cues in intuitive interactions between humans. Hence, it is essential to include these fundamentals in robotic behavior strategies when interacting with humans to…

Robotics · Computer Science 2023-11-08 Thorsten Hempel , Laslo Dinges , Ayoub Al-Hamadi

Large language models have given social robots the ability to autonomously engage in open-domain conversations. However, they are still missing a fundamental social skill: making use of the multiple modalities that carry social…

Robotics · Computer Science 2025-08-19 Ruben Janssens , Tony Belpaeme

Robotic agents that share autonomy with a human should leverage human domain knowledge and account for their preferences when completing a task. This extra knowledge can dramatically improve plan efficiency and user-satisfaction, but these…

Robotics · Computer Science 2018-05-22 Rosario Scalise , Yonatan Bisk , Maxwell Forbes , Daqing Yi , Yejin Choi , Siddhartha Srinivasa

This paper explores the challenges faced by assistive robots in effectively cooperating with humans, requiring them to anticipate human behavior, predict their actions' impact, and generate understandable robot actions. The study focuses on…

Robotics · Computer Science 2023-08-22 Chao Wang , Theodoros Stouraitis , Anna Belardinelli , Stephan Hasler , Michael Gienger

We introduce a task and dataset for referring expression generation and comprehension in multi-agent embodied environments. In this task, two agents in a shared scene must take into account one another's visual perspective, which may be…

Computation and Language · Computer Science 2024-10-08 Zineng Tang , Lingjun Mao , Alane Suhr

Nonverbal visual symbols and displays play an important role in communication when humans and robots work collaboratively. However, few studies have investigated how different types of non-verbal cues affect objective task performance,…

Robotics · Computer Science 2025-12-15 Matthew Ebisu , Hang Yu , Reuben Aronson , Elaine Short

The current spread of social and assistive robotics applications is increasingly highlighting the need for robots that can be easily taught and interacted with, even by users with no technical background. Still, it is often difficult to…

Human-Computer Interaction · Computer Science 2023-05-01 Chao Wang , Anna Belardinelli , Stephan Hasler , Theodoros Stouraitis , Daniel Tanneberg , Michael Gienger

Group interactions are a natural part of our daily life, and as robots become more integrated into society, they must be able to socially interact with multiple people at the same time. However, group human-robot interaction (HRI) poses…

Robotics · Computer Science 2024-12-23 Massimiliano Nigro , Emmanuel Akinrintoyo , Nicole Salomons , Micol Spitale

A fruitful collaboration is based on the mutual knowledge of each other skills and on the possibility of communicating their own limits and proposing alternatives to adapt the execution of a task to the capabilities of the collaborators.…

Robotics · Computer Science 2022-06-13 Davide Ferrari , Federico Benzi , Cristian Secchi

Strategies are necessary to mitigate the impact of unexpected behavior in collaborative robotics, and research to develop solutions is lacking. Our aim here was to explore the benefits of an affective interaction, as opposed to a more…

Robotics · Computer Science 2020-05-18 Adriana Hamacher , Nadia Bianchi-Berthouze , Anthony G. Pipe , Kerstin Eder

For generative AI agents to partner effectively with human users, the ability to accurately predict human intent is critical. But this ability to collaborate remains limited by a critical deficit: an inability to model common ground. We…

Computation and Language · Computer Science 2026-04-21 Peter Zeng , Weiling Li , Amie Paige , Zhengxiang Wang , Panagiotis Kaliosis , Dimitris Samaras , Gregory Zelinsky , Susan Brennan , Owen Rambow