English
Related papers

Related papers: Enhancing Explainability with Multimodal Context R…

200 papers

Successful adoption of industrial robots will strongly depend on their ability to safely and efficiently operate in human environments, engage in natural communication, understand their users, and express intentions intuitively while…

Robotics · Computer Science 2025-02-26 Tim Schreiter , Andrey Rudenko , Jens V. Rüppel , Martin Magnusson , Achim J. Lilienthal

To effectively engage in human society, the ability to adapt, filter information, and make informed decisions in ever-changing situations is critical. As robots and intelligent agents become more integrated into human life, there is a…

Artificial Intelligence · Computer Science 2025-11-13 Mingyang Mao , Mariela M. Perez-Cabarcas , Utteja Kallakuri , Nicholas R. Waytowich , Xiaomin Lin , Tinoosh Mohsenin

The growing adoption of augmented and virtual reality (AR and VR) technologies in industrial training and on-the-job assistance has created new opportunities for intelligent, context-aware support systems. As workers perform complex tasks…

Human-Computer Interaction · Computer Science 2025-11-18 Mahya Qorbani , Kamran Paynabar , Mohsen Moghaddam

Current technological advances open up new opportunities for bringing human-machine interaction to a new level of human-centered cooperation. In this context, a key issue is the semantic understanding of the environment in order to enable…

Robotics · Computer Science 2022-11-08 Thorsten Hempel , Marc-André Fiedler , Aly Khalifa , Ayoub Al-Hamadi , Laslo Dinges

Integrating generative AI such as Large Language Models into social robots has improved their ability to engage in natural, human-like communication. This study presents a method to examine their persuasive capabilities. We designed an…

The recent enthusiasm for artificial intelligence (AI) is due principally to advances in deep learning. Deep learning methods are remarkably accurate, but also opaque, which limits their potential use in safety-critical applications. To…

In recent years, the demand for social robots has grown, requiring them to adapt their behaviors based on users' states. Accurately assessing user experience (UX) in human-robot interaction (HRI) is crucial for achieving this adaptability.…

Robotics · Computer Science 2025-08-01 Ryo Miyoshi , Yuki Okafuji , Takuya Iwamoto , Junya Nakanishi , Jun Baba

In the field of Human-Robot Interaction (HRI), a fundamental challenge is to facilitate human understanding of robots. The emerging domain of eXplainable HRI (XHRI) investigates methods to generate explanations and evaluate their impact on…

To achieve natural and intuitive interaction with people, HRI frameworks combine a wide array of methods for human perception, intention communication, human-aware navigation and collaborative action. In practice, when encountering…

When designing robots to assist in everyday human activities, it is crucial to enhance user requests with visual cues from their surroundings for improved intent understanding. This process is defined as a multimodal classification task.…

Computation and Language · Computer Science 2025-06-18 Shang-Chi Tsai , Seiya Kawano , Angel Garcia Contreras , Koichiro Yoshino , Yun-Nung Chen

This paper addresses the topic of robustness under sensing noise, ambiguous instructions, and human-robot interaction. We take a radically different tack to the issue of reliable embodied AI: instead of focusing on formal verification…

Robotics · Computer Science 2026-01-13 Kenneth Kwok , Basura Fernando , Qianli Xu , Vigneshwaran Subbaraju , Dongkyu Choi , Boon Kiat Quek

We describe Platform for Situated Intelligence, an open-source framework for multimodal, integrative-AI systems. The framework provides infrastructure, tools, and components that enable and accelerate the development of applications that…

Artificial Intelligence · Computer Science 2020-10-14 Sean Andrist , Dan Bohus

The field of Augmented Reality (AR) based Human Robot Interaction (HRI) has progressed significantly since its inception more than two decades ago. With more advanced devices, particularly head-mounted displays (HMD), freely available…

Robotics · Computer Science 2019-10-11 David Puljiz , Björn Hein

Advances in large language models (LLMs) are profoundly reshaping the field of human-robot interaction (HRI). While prior work has highlighted the technical potential of LLMs, few studies have systematically examined their human-centered…

Robotics · Computer Science 2026-02-18 Yufeng Wang , Yuan Xu , Anastasia Nikolova , Yuxuan Wang , Jianyu Wang , Chongyang Wang , Xin Tong

Autonomous vehicles (AVs) are poised to redefine transportation by enhancing road safety, minimizing human error, and optimizing traffic efficiency. The success of AVs depends on their ability to interpret complex, dynamic environments…

Multimedia · Computer Science 2025-07-11 Abolfazl Zarghani , Amirhossein Ebrahimi , Amir Malekesfandiari

As robots are increasingly deployed in real-world scenarios, a key question is how to best transfer knowledge learned in one environment to another, where shifting constraints and human preferences render adaptation challenging. A central…

Human-Computer Interaction · Computer Science 2022-05-18 Andreea Bobu , Andi Peng

As social robots see increasing deployment within the general public, improving the interaction with those robots is essential. Spoken language offers an intuitive interface for the human-robot interaction (HRI), with dialogue management…

Robotics · Computer Science 2025-02-04 Merle M. Reimann , Florian A. Kunneman , Catharine Oertel , Koen V. Hindriks

Human interaction is essential for issuing personalized instructions and assisting robots when failure is likely. However, robots remain largely black boxes, offering users little insight into their evolving capabilities and limitations. To…

Human-Computer Interaction · Computer Science 2026-01-22 Lauren W. Wang , Mohamed Kari , Parastoo Abtahi

The representation of the knowledge needed by a robot to perform complex tasks is restricted by the limitations of perception. One possible way of overcoming this situation and designing "knowledgeable" robots is to rely on the interaction…

Artificial Intelligence · Computer Science 2013-08-02 Emanuele Bastianelli , Domenico Bloisi , Roberto Capobianco , Guglielmo Gemignani , Luca Iocchi , Daniele Nardi

Public distrust of self-driving cars is growing. Studies emphasize the need for interpreting the behavior of these vehicles to passengers to promote trust in autonomous systems. Interpreters can enhance trust by improving transparency and…

Human-Computer Interaction · Computer Science 2025-01-14 Xuewen Luo , Fan Ding , Ruiqi Chen , Rishikesh Panda , Junnyong Loo , Shuyun Zhang