English
Related papers

Related papers: Spot-On: A Mixed Reality Interface for Multi-Robot…

200 papers

With the continuous breakthroughs in core technology, the dawn of large-scale integration of robotic systems into daily human life is on the horizon. Multi-robot systems (MRS) built on this foundation are undergoing drastic evolution. The…

Robotics · Computer Science 2024-08-23 Bin Wu , C Steve Suh

In this poster, we present RealityDrop, a novel multimodal framework that uses Mixed Reality (MR) technology to manipulate, display, and transfer virtual content across different display systems. Employing MR as the centre of control,…

Human-Computer Interaction · Computer Science 2023-10-12 Jeremy McDade , Allison Jing , Andrew Cunningham

Mixed Reality (MR) interfaces have been extensively explored for controlling mobile robots, but there is limited research on their application to managing teams of robots. This paper presents HORUS: Holistic Operational Reality for Unified…

Robotics · Computer Science 2025-06-04 Omotoye Shamsudeen Adekoya , Antonio Sgorbissa , Carmine Tommaso Recchiuto

When humans work together to complete a joint task, each person builds an internal model of the situation and how it will evolve. Efficient collaboration is dependent on how these individual models overlap to form a shared mental model…

Robotics · Computer Science 2022-08-26 Wesley P. Chan , Morgan Crouch , Khoa Hoang , Charlie Chen , Nicole Robinson , Elizabeth Croft

Human-robot collaboration frequently requires extensive communication, e.g., using natural language and gestures. Augmented reality (AR) has provided an alternative way of bridging the communication gap between robots and people. However,…

Robotics · Computer Science 2022-02-28 Kishan Chandan , Vidisha Kudalkar , Xiang Li , Shiqi Zhang

Large Multimodal Models (LMMs) have shown strong potential for assisting users in tasks, such as programming, content creation, and information access, yet their interaction remains largely limited to traditional interfaces such as desktops…

Human-Computer Interaction · Computer Science 2026-02-12 Liuchuan Yu , Yongqi Zhang , Lap-Fai Yu

In the context of Intelligent Transportation Systems and the delivery of goods, new technology approaches need to be developed in order to cope with certain challenges that last mile delivery entails, such as navigation in an urban…

The field of Augmented Reality (AR) based Human Robot Interaction (HRI) has progressed significantly since its inception more than two decades ago. With more advanced devices, particularly head-mounted displays (HMD), freely available…

Robotics · Computer Science 2019-10-11 David Puljiz , Björn Hein

This literature review investigates the transformative potential of mixed reality (MR) technology, where we explore the intersection of contemporary technological advancements, modern deep learning recommendation systems, and social…

Human-Computer Interaction · Computer Science 2024-04-29 Sparsh Srivastava

We provide an experimental evaluation of a wearable augmented reality (AR) system we have developed for human-robot teams working on tasks requiring collaboration in shared physical workspace. Recent advances in AR technology have…

There is invariably a trade-off between safety and efficiency for collaborative robots (cobots) in human-robot collaborations. Robots that interact minimally with humans can work with high speed and accuracy but cannot adapt to new tasks or…

Robotics · Computer Science 2022-10-13 Xiangjie Yan , Yongpeng Jiang , Chen Chen , Leiliang Gong , Ming Ge , Tao Zhang , Xiang Li

We present an augmented reality human-swarm interface that combines two modalities of interaction: environment-oriented and robot-oriented. The environment-oriented modality allows the user to modify the environment (either virtual or…

Robotics · Computer Science 2019-01-25 Jayam Patel , Yicong Xu , Carlo Pinciroli

This paper proposes a novel approach to scaling distributed collaboration in mixed reality by virtualizing collaborative tasks as independent, installable environments. By mapping group activities into dedicated virtual spaces that adapt to…

Human-Computer Interaction · Computer Science 2025-04-07 Euijun Jung , Youngki Lee

Autonomous or teleoperated robots have been playing increasingly important roles in civil applications in recent years. Across the different civil domains where robots can support human operators, one of the areas where they can have more…

The new industrial settings are characterized by the presence of human and robots that work in close proximity, cooperating in performing the required job. Such a collaboration, however, requires to pay attention to many aspects. Firstly,…

Robotics · Computer Science 2024-09-12 Davide Ferrari , Andrea Pupa , Alberto Signoretti , Cristian Secchi

Human-robot teaming offers great potential because of the opportunities to combine strengths of heterogeneous agents. However, one of the critical challenges in realizing an effective human-robot team is efficient information exchange -…

Robotics · Computer Science 2019-09-17 Jason M. Gregory , Christopher Reardon , Kevin Lee , Geoffrey White , Ki Ng , Caitlyn Sims

Advances in computer networks and rendering systems facilitate the creation of distributed collaborative environments in which the distribution of information at remote locations allows efficient communication. One of the challenges in…

Networking and Internet Architecture · Computer Science 2018-12-11 Felix G. Hamza-Lup , Jannick P. Rolland

In the past decade, although single-robot perception has made significant advancements, the exploration of multi-robot collaborative perception remains largely unexplored. This involves fusing compressed, intermittent, limited,…

Robotics · Computer Science 2024-05-24 Yang Zhou , Long Quang , Carlos Nieto-Granda , Giuseppe Loianno

Many new methodologies for the control of large-scale multi-agent systems are based on macroscopic representations of the emerging system dynamics, in the form of continuum approximations of large ensembles. These techniques, that are…

Mixed Reality (MR) presents novel opportunities to investigate how individuals perceive themselves and others during shared, augmented experiences within a common physical environment. Previous research has demonstrated that users can…

Human-Computer Interaction · Computer Science 2025-09-15 Yuan He , Brendan Rooney , Rachel McDonnell