English
Related papers

Related papers: Multimodal Feedback for Task Guidance in Augmented…

200 papers

Optical see-through head-mounted displays (OST HMDs) are a major output medium for Augmented Reality, which have seen significant growth in popularity and usage among the general public due to the growing release of consumer-oriented…

Human-Computer Interaction · Computer Science 2017-10-02 Jens Grubert , Yuta Itoh , Kenneth Moser , J. Edward Swan

Optical see-through head-mounted displays (OST HMDs) are a popular output medium for mobile Augmented Reality (AR) applications. To date, they lack efficient text entry techniques. Smartphones are a major text entry medium in mobile…

Human-Computer Interaction · Computer Science 2023-09-11 Jens Grubert , Lukas Witzani , Alexander Otte , Travis Gesslein , Matthias Kranz , Per Ola Kristensson

We present a technique for providing remote tactile feedback to the thumb and index finger via a wristband device. This enables haptics for touch and pinch interactions in mixed reality (MR) while keeping the hand entirely free. We achieve…

Human-Computer Interaction · Computer Science 2024-10-31 Yudai Tanaka , Neil Weiss , Robert Cole Bolger-Cruz , Jess Hartcher-O'Brien , Brendan Flynn , Roger Boldu , Nicholas Colonnese

Embodied intelligence has advanced rapidly in recent years; however, bimanual manipulation-especially in contact-rich tasks remains challenging. This is largely due to the lack of datasets with rich physical interaction signals, systematic…

Robotics · Computer Science 2026-04-23 Qianxi Hua , Xinyue Li , Zheng Yan , Yang Li , Chi Zhang , Yongyao Li , Yufei Liu

Industrial process tomography (IPT) is a specialized imaging technique widely used in industrial scenarios for process supervision and control. Today, augmented/mixed reality (AR/MR) is increasingly being adopted in many industrial…

Human-Computer Interaction · Computer Science 2024-03-12 Yuchong Zhang , Yueming Xuan , Rahul Yadav , Adel Omrani , Morten Fjeld

Suboptimal interaction with patient data and challenges in mastering 3D anatomy based on ill-posed 2D interventional images are essential concerns in image-guided therapies. Augmented reality (AR) has been introduced in the operating rooms…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Javad Fotouhi , Arian Mehrfard , Tianyu Song , Alex Johnson , Greg Osgood , Mathias Unberath , Mehran Armand , Nassir Navab

Haptic feedback enhances collision avoidance by providing directional obstacle information to operators during unmanned aerial vehicle (UAV) teleoperation. However, such feedback is often rendered via haptic joysticks, which are unfamiliar…

As a result of an increasingly automatized and digitized industry, processes are becoming more complex. Augmented Reality has shown considerable potential in assisting workers with complex tasks by enhancing user understanding and…

Human-Computer Interaction · Computer Science 2020-09-01 Linh Kästner , Leon Eversberg , Marina Mursa , Jens Lambrecht

Optical see-through head-mounted displays (OST HMDs) typically display virtual content at a fixed focal distance while users need to integrate this information with real-world information at different depth layers. This problem is…

Human-Computer Interaction · Computer Science 2019-09-09 Anna Eiberger , Per Ola Kristensson , Susanne Mayr , Matthias Kranz , Jens Grubert

As augmented reality technology and hardware become more mature and affordable, researchers have been exploring more intuitive and discoverable interaction techniques for immersive environments. In this paper, we investigate multimodal…

Human-Computer Interaction · Computer Science 2022-12-02 Xiaoyan Zhou , Adam S. Williams , Francisco R. Ortega

Head-worn augmented reality (AR) is a hotly pursued and increasingly feasible contender paradigm for replacing or complementing smartphones and watches for continual information consumption. Here, we compare three different AR navigation…

Human-Computer Interaction · Computer Science 2025-10-31 Radha Kumaran , You-Jin Kim , Anne E Milner , Tom Bullock , Barry Giesbrecht , Tobias Höllerer

Augmented Reality (AR) and Mobile Augmented Reality (MAR) applications have gained much research and industry attention these days. The mobile nature of MAR applications limits users' interaction capabilities such as inputs, and haptic…

Human-Computer Interaction · Computer Science 2017-09-13 Carlos Bermejo , Pan Hui

While visual search for targets within a complex scene might benefit from using augmented-reality (AR) head-mounted display (HMD) technologies helping to efficiently direct human attention, imperfectly reliable automation support could…

Human-Computer Interaction · Computer Science 2023-03-28 Amelia C. Warden , Christopher D. Wickens , Daniel Rehberg , Francisco R. Ortega , Benjamin A. Clegg

Previous work has shown that the addition of haptic feedback to the hands can improve awareness of tool-tissue interactions and enhance performance of teleoperated tasks in robot-assisted minimally invasive surgery. However, hand-based…

Robotics · Computer Science 2025-07-11 Brian B. Vuong , Josie Davidson , Sangheui Cheon , Kyujin Cho , Allison M. Okamura

Augmented Reality (AR) is increasingly utilized to guide users through complex spatial tasks in domains such as manufacturing, non-destructive testing, and surgery. These applications often require strict compliance with 5D+ trajectories…

Human-Computer Interaction · Computer Science 2026-05-22 Christian Masuhr , Julian Koch , Arne Wendt , Thorsten Schüppstuhl

The integration of haptics within Augmented Reality may help to deliver an enriched experience, while facilitating the performance of specific actions (e.g. repositioning or resizin ) that are still dependent on the user's skills. This…

Human-Computer Interaction · Computer Science 2025-01-14 Diego Vaquero-Melchor , Ana M. Bernardos

Existing augmented reality (AR) applications often ignore occlusion between real hands and virtual objects when incorporating virtual objects in our views. The challenges come from the lack of accurate depth and mismatch between real and…

Graphics · Computer Science 2020-06-24 Xiao Tang , Xiaowei Hu , Chi-Wing Fu , Daniel Cohen-Or

Grasping is a fundamental skill for interacting with the environment. However, this ability can be difficult for some (e.g. due to disability). Wearable robotic solutions can enhance or restore hand function, and recent advances have…

Robotics · Computer Science 2025-04-07 Chen Hu , Timothy Neate , Shan Luo , Letizia Gionfrida

Autonomous manipulation of articulated objects remains a fundamental challenge for robots in human environments. Vision-based methods can infer hidden kinematics but can yield imprecise estimates on unfamiliar objects. Tactile approaches…

Robotics · Computer Science 2026-04-03 Leiyao Cui , Zihang Zhao , Sirui Xie , Wenhuan Zhang , Zhi Han , Yixin Zhu

This paper presents the development of a multi-sensor user interface to facilitate the instruction of arc welding tasks. Traditional methods to acquire hand-eye coordination skills are typically conducted through one-to-one instruction…

Human-Computer Interaction · Computer Science 2022-06-29 Hoi-Yin Lee , Peng Zhou , Anqing Duan , Jiangliu Wang , Victor Wu , David Navarro-Alarcon