English
Related papers

Related papers: ARGUS: Visualization of AI-Assisted Task Guidance …

200 papers

In this paper, we present Retargetable AR, a novel AR framework that yields an AR experience that is aware of scene contexts set in various real environments, achieving natural interaction between the virtual and real worlds. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Tomu Tahara , Takashi Seno , Gaku Narita , Tomoya Ishikawa

Traditional 3D modeling requires technical expertise, specialized software, and time-intensive processes, making it inaccessible for many users. Our research aims to lower these barriers by combining generative AI and augmented reality (AR)…

Graphics · Computer Science 2025-05-01 Majid Behravan , Maryam Haghani , Denis Gracanin

This paper proposes an interactive system for mobile devices controlled by hand gestures aimed at helping people with visual impairments. This system allows the user to interact with the device by making simple static and dynamic hand…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Samer Alashhab , Antonio Javier Gallego , Miguel Ángel Lozano

The global aging trend compels older adults to navigate the evolving digital landscape, presenting a substantial challenge in mastering smartphone applications. While Augmented Reality (AR) holds promise for enhancing learning and user…

Human-Computer Interaction · Computer Science 2024-02-08 Xiaofu Jin , Wai Tong , Xiaoying Wei , Xian Wang , Emily Kuang , Xiaoyu Mo , Huamin Qu , Mingming Fan

Innovative technologies, such as Augmented Reality (AR), introduce new interaction paradigms, demanding the identification of software requirements during the software development process. In general, design recommendations are related to…

Human-Computer Interaction · Computer Science 2025-07-30 Stefan Graser , Martin Schrepp , Stephan Böhm

This paper introduces the concept of augmented conversation, which aims to support co-located in-person conversations via embedded speech-driven on-the-fly referencing in augmented reality (AR). Today computing technologies like smartphones…

Human-Computer Interaction · Computer Science 2024-05-30 Shivesh Jadon , Mehrad Faridan , Edward Mah , Rajan Vaish , Wesley Willett , Ryo Suzuki

As augmented reality (AR) becomes increasingly integrated into everyday life, ensuring the safety and trustworthiness of its virtual content is critical. Our research addresses the risks of task-detrimental AR content, particularly that…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Yanming Xiu

Riding on the success of LLMs with retrieval-augmented generation (RAG), there has been a growing interest in augmenting agent systems with external memory databases. However, the existing systems focus on storing text information in their…

Artificial Intelligence · Computer Science 2025-10-20 Jitesh Jain , Shubham Maheshwari , Ning Yu , Wen-mei Hwu , Humphrey Shi

Surgical planning for congenital heart diseases requires a collaborative approach, traditionally involving the 3D-printing of physical heart models for inspection by surgeons and cardiologists. Recent advancements in mobile augmented…

Human-Computer Interaction · Computer Science 2024-02-08 Pratham Mehta , Harsha Karanth , Haoyang Yang , Timothy Slesnick , Fawwaz Shaw , Duen Horng Chau

The current spread of social and assistive robotics applications is increasingly highlighting the need for robots that can be easily taught and interacted with, even by users with no technical background. Still, it is often difficult to…

Human-Computer Interaction · Computer Science 2023-05-01 Chao Wang , Anna Belardinelli , Stephan Hasler , Theodoros Stouraitis , Daniel Tanneberg , Michael Gienger

Extended Reality (XR) systems for physical skill training have largely emphasized simulation rather than real-time in-situ instruction. We present WeldAR, an Augmented Reality (AR) system with five learning modules that overlays real-time…

Human-Computer Interaction · Computer Science 2026-03-10 Chuhan Xu , Lia Sparingga Purnamasari , Zhenfang Chen , Daragh Byrne , Dina El-Zanfaly

Remote collaborative work has become pervasive in many settings, from engineering to medical professions. Users are immersed in virtual environments and communicate through life-sized avatars that enable face-to-face collaboration. Within…

Human-Computer Interaction · Computer Science 2023-02-17 Catarina G. Fidalgo , Maurício Sousa , Daniel Mendes , Rafael Kuffner dos Anjos , Daniel Medeiros , Karan Singh , Joaquim Jorge

Context-aware AR instruction enables adaptive and in-situ learning experiences. However, hardware limitations and expertise requirements constrain the creation of such instructions. With recent developments in Generative Artificial…

Human-Computer Interaction · Computer Science 2025-01-29 Jingyu Shi , Rahul Jain , Seungguen Chi , Hyungjun Doh , Hyunggun Chi , Alexander J. Quinn , Karthik Ramani

We investigate how vibrotactile wrist feedback can enhance spatial guidance for handheld tool movement in optical see-through augmented reality (AR). While AR overlays are widely used to support surgical tasks, visual occlusion, lighting…

Human-Computer Interaction · Computer Science 2026-01-21 Yue Yang , Christoph Leuze , Brian Hargreaves , Bruce Daniel , Fred M Baik

Localization and mapping is the foundational technology for augmented reality (AR) that enables sharing and persistence of digital content in the real world. While significant progress has been made, researchers are still mostly driven by…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Paul-Edouard Sarlin , Mihai Dusmanu , Johannes L. Schönberger , Pablo Speciale , Lukas Gruber , Viktor Larsson , Ondrej Miksik , Marc Pollefeys

As the integration of augmented reality (AR) technology in head-up displays (HUDs) becomes more prevalent in vehicles, it is crucial to understand how to design and evaluate AR interfaces to ensure safety. With new AR displays capable of…

Human-Computer Interaction · Computer Science 2025-05-05 Nayara de Oliveira Faria , Joseph L. Gabbard

Augmented Reality (AR) enables intuitive interaction with virtual annotations overlaid on the real world, supporting a wide range of applications such as remote assistance, education, and industrial training. However, as the number of…

Human-Computer Interaction · Computer Science 2025-09-16 Zahra Borhani , Ali Ebrahimpour-Boroojeny , Francisco R. Ortega

Augmented and Mixed Reality are emerging as likely successors to the mobile internet. However, many technical challenges remain. One of the key requirements of these systems is the ability to create a continuity between physical and virtual…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Scott Y. L. Chin , Bradley R. Quinton

Video large language models have not yet been widely deployed, largely due to their tendency to hallucinate. Typical benchmarks for Video-LLMs rely simply on multiple-choice questions. Unfortunately, VideoLLMs hallucinate far more…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Ruchit Rawal , Reza Shirkavand , Heng Huang , Gowthami Somepalli , Tom Goldstein

Augmented reality (AR) provides ways to visualize missing view samples for novel view synthesis. Existing approaches present 3D annotations for new view samples and task users with taking images by aligning the AR display. This data…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Ayaka Yasunaga , Hideo Saito , Shohei Mori