English
Related papers

Related papers: ARGUS: Visualization of AI-Assisted Task Guidance …

200 papers

Audience reactions can considerably enhance live experiences; conversely, in anytime-anywhere augmented reality (AR) experiences, large crowds of people might not always be available to congregate. To get closer to simulating live events…

Human-Computer Interaction · Computer Science 2025-11-05 You-Jin Kim , Misha Sra , Tobias Höllerer

Speaking aloud to a wearable AR assistant in public can be socially awkward, and re-articulating the same requests every day creates unnecessary effort. We present SpeechLess, a wearable AR assistant that introduces a speech-based intent…

Human-Computer Interaction · Computer Science 2026-04-14 Yoonsang Kim , Devshree Jadeja , Divyansh Pradhan , Yalong Yang , Arie Kaufman

This paper presents the development of a multi-sensor user interface to facilitate the instruction of arc welding tasks. Traditional methods to acquire hand-eye coordination skills are typically conducted through one-to-one instruction…

Human-Computer Interaction · Computer Science 2022-06-29 Hoi-Yin Lee , Peng Zhou , Anqing Duan , Jiangliu Wang , Victor Wu , David Navarro-Alarcon

While augmented reality (AR) enables new ways to play, tell stories, and explore ideas rooted in the physical world, authoring personalized AR content remains difficult for non-experts, often requiring professional tools and time. Prior…

Procedural tasks with multiple ordered steps are ubiquitous in daily life. Recent advances in multimodal large language models (MLLMs) have enabled personal assistants that support daily activities. However, existing systems primarily…

Artificial Intelligence · Computer Science 2026-05-07 Lilin Xu , Bufang Yang , Siyang Jiang , Kaiwei Liu , Kaiyuan Hou , Yuang Fan , Hongkai Chen , Zhenyu Yan , Xiaofan Jiang

We present a user interface (UI) based on augmented reality (AR) with head-mounted display (HMD) for improving situational awareness during critical operation and improve human efficiency on operations. The UI displays contextual…

Human-Computer Interaction · Computer Science 2021-03-29 Dany Naser Addin , Benoit Ozell

In this paper, we propose XGC-AVis, a multi-agent framework that enhances the audio-video temporal alignment capabilities of multimodal large models (MLLMs) and improves the efficiency of retrieving key video segments through 4 stages:…

Multimedia · Computer Science 2025-09-30 Yuqin Cao , Xiongkuo Min , Yixuan Gao , Wei Sun , Zicheng Zhang , Jinliang Han , Guangtao Zhai

Augmented reality (AR) has great potential for use in healthcare applications, especially remote medical training and supervision. In this paper, we analyze the usage of an AR communication system to teach a medical procedure, the placement…

Human-Computer Interaction · Computer Science 2023-12-15 Manuel Rebol , Krzysztof Pietroszek , Neal Sikka , Claudia Ranniger , Colton Hood , Adam Rutenberg , Puja Sasankan , Christian Gütl

The integration of extended reality (XR) with artificial intelligence (AI) introduces a new paradigm for user interaction, enabling AI to perceive user intent, stimulate the senses, and influence decision-making. We explored the impact of…

Human-Computer Interaction · Computer Science 2025-07-16 Ze Dong , Binyang Han , Jingjing Zhang , Ruoyu Wen , Barrett Ens , Adrian Clark , Tham Piumsomboon

Digital technologies are reshaping how people experience their surroundings, often pulling focus toward virtual spaces and making it harder to stay present and engaged. Wearable augmented reality (AR), by embedding digital information into…

Human-Computer Interaction · Computer Science 2025-03-05 Tram Thi Minh Tran

In this work, a new and innovative way of spatial computing that appeared recently in the bibliography called True Augmented Reality (AR), is employed in cultural heritage preservation. This innovation could be adapted by the Virtual…

Augmented reality has great potential for embedding data visualizations in the world around the user. While this can enhance users' understanding of their surroundings, it also bears the risk of overwhelming their senses with a barrage of…

Human-Computer Interaction · Computer Science 2026-02-24 Sebastian Hubenschmid , Arvind Srinivasan , Niklas Elmqvist , Dieter Schmalstieg , Michael Sedlmair

Mobile Augmented Reality (MAR) integrates computer-generated virtual objects with physical environments for mobile devices. MAR systems enable users to interact with MAR devices, such as smartphones and head-worn wearables, and performs…

Human-Computer Interaction · Computer Science 2022-08-29 Jacky Cao , Kit-Yung Lam , Lik-Hang Lee , Xiaoli Liu , Pan Hui , Xiang Su

Surgical navigation provides real-time guidance by estimating the pose of patient anatomy and surgical instruments to visualize relevant intraoperative information. In conventional systems, instruments are typically tracked using fiducial…

Human-Computer Interaction · Computer Science 2026-03-10 Jiaming Zhang , Mingxu Liu , Hongchao Shu , Ruixing Liang , Yihao Liu , Ojas Taskar , Amir Kheradmand , Mehran Armand , Alejandro Martin-Gomez

Recent developments in artificial intelligence (AI) have permeated through an array of different immersive environments, including virtual, augmented, and mixed realities. AI brings a wealth of potential that centers on its ability to…

Human-Computer Interaction · Computer Science 2024-05-10 Wangfan Li , Rohit Mallick , Carlos Toxtli-Hernandez , Christopher Flathmann , Nathan J. McNeese

With the rapid advancement of technology, Augmented Reality (AR) technology, known for its ability to deeply integrate virtual information with the real world, is gradually transforming traditional work modes and teaching methods.…

Artificial Intelligence · Computer Science 2024-04-30 Keqin Li , Peng Xirui , Jintong Song , Bo Hong , Jin Wang

3D scene graphs have empowered robots with semantic understanding for navigation and planning. However, current functional scene graphs primarily focus on static element detection, lacking the actionable kinematic information required for…

The evolution of decentralized microservice-based systems is challenging. These challenges are classified into static and dynamic categories. Regarding the static perspective, documenting and visualizing the fluid application topology is…

Software Engineering · Computer Science 2022-07-27 Amr S. Abdelfattah

Human video generation task has gained significant attention with the advancement of deep generative models. Generating realistic videos with human movements is challenging in nature, due to the intricacies of human body topology and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zhangsihao Yang , Mengyi Shan , Mohammad Farazi , Wenhui Zhu , Yanxi Chen , Xuanzhao Dong , Yalin Wang

The integration of augmented reality (AR), extended reality (XR), and virtual reality (VR) technologies in agriculture has shown significant promise in enhancing various agricultural practices. Mobile robots have also been adopted as…

Robotics · Computer Science 2024-11-07 Caio Mucchiani , Dimitrios Chatziparaschis , Konstantinos Karydis