English
Related papers

Related papers: Toward Safe, Trustworthy and Realistic Augmented R…

200 papers

We present Explainable XR, an end-to-end framework for analyzing user behavior in diverse eXtended Reality (XR) environments by leveraging Large Language Models (LLMs) for data interpretation assistance. Existing XR user analytics…

Human-Computer Interaction · Computer Science 2025-03-12 Yoonsang Kim , Zainab Aamir , Mithilesh Singh , Saeed Boorboor , Klaus Mueller , Arie E. Kaufman

In order to address the limitations of gestural capabilities in physical robots, researchers in Virtual, Augmented, Mixed Reality Human-Robot Interaction (VAM-HRI) have been using augmented-reality visualizations that increase robot…

Robotics · Computer Science 2022-05-16 Ipek Goktan , Karen Ly , Thomas R. Groechel , Maja J. Mataric

Mixed Reality (MR) technologies such as Virtual and Augmented Reality (VR, AR) are well established in medical practice, enhancing diagnostics, treatment, and education. However, there are still some limitations and challenges that may be…

Human-Computer Interaction · Computer Science 2025-07-28 Aliaksandr Marozau , Barbara Karpowicz , Tomasz Kowalewski , Pavlo Zinevych , Wiktor Stawski , Adam Kuzdraliński , Wiesław Kopeć

Extended Reality in early childhood education presents high-risk challenges due to children's rapid developmental changes. While augmented and virtual reality offer immersive pedagogical benefits, they often impose excessive cognitive load…

Human-Computer Interaction · Computer Science 2026-01-28 Supriya Khadka , Sanchari Das

As spatial computing and multimodal LLMs mature, AR is tending to become an intuitive "thinking tool," embedding semantic and context-aware intelligence directly into everyday environments. This paper explores how always-on AR can…

Human-Computer Interaction · Computer Science 2025-05-07 Xiaoan Liu

Computer-using agents powered by Vision-Language Models (VLMs) have demonstrated human-like capabilities in operating digital environments like mobile platforms. While these agents hold great promise for advancing digital automation, their…

Augmented Reality (AR) provides a safe and low-cost option for hazardous safety training that allows for the visualization of aspects that may be invisible, such as radiation. Effectively visually communicating such threats in the…

Human-Computer Interaction · Computer Science 2024-03-11 Fintan McGee , Roderick McCall , Joan Baixauli

Social Virtual Reality (VR) platforms provide immersive social experiences but also expose users to serious risks of online harassment. Existing safety measures are largely reactive, while proactive solutions that detect harassment behavior…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Junhee Lee , Minseok Kim , Hwanjo Heo , Seungwon Woo , Jinwoo Kim

The emergence of virtual companions is transforming the evolution of intelligent systems that effortlessly cater to the unique requirements of users. These advanced systems not only take into account the user present capabilities,…

Human-Computer Interaction · Computer Science 2023-09-06 Ziaullah Momand , Jonathan H. Chan , Pornchai Mongkolnam

Visual Language Models (VLMs) are vulnerable to adversarial attacks, especially those from adversarial images, which is however under-explored in literature. To facilitate research on this critical safety problem, we first construct a new…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Youcheng Huang , Fengbin Zhu , Jingkun Tang , Pan Zhou , Wenqiang Lei , Jiancheng Lv , Tat-Seng Chua

Recent advances in generative artificial intelligence have enabled the creation of highly realistic image forgeries, raising significant concerns about digital media authenticity. While existing detection methods demonstrate promising…

Multimedia · Computer Science 2025-04-15 Junhao Xu , Jingjing Chen , Yang Jiao , Jiacheng Zhang , Zhiyu Tan , Hao Li , Yu-Gang Jiang

The emergence of Vision Language Models (VLMs) is a significant advancement in integrating computer vision with Large Language Models (LLMs) to produce detailed text descriptions based on visual inputs, yet it introduces new security…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Weimin Lyu , Lu Pang , Tengfei Ma , Haibin Ling , Chao Chen

Virtual content in Augmented Reality (AR) applications can be constructed according to the designer's requirements, but real environments, are difficult to be accurate control or completely reproduce. This makes it difficult to prototype AR…

Human-Computer Interaction · Computer Science 2024-09-25 Tianyu Liu , Weiping He , Mark Billinghurst

Immersive environments enable users to engage in embodied interaction, enhancing the sensemaking processes involved in completing tasks such as immersive analytics. Previous comparative studies on immersive analytics using augmented and…

Human-Computer Interaction · Computer Science 2024-04-08 Xiaoyan Zhou , Anil Ufuk Batmaz , Adam S. Williams , Dylan Schreiber , Francisco Ortega

Recent advances in embodied Vision-Language Agentic Systems (VLAS), powered by large vision-language models (LVLMs), enable AI systems to perceive and reason over real-world scenes. Within this context, environmental signals such as traffic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Jiamin Chang , Minhui Xue , Ruoxi Sun , Shuchao Pang , Salil S. Kanhere , Hammond Pearce

Communication is the most useful tool to impart knowledge, understand ideas, clarify thoughts and expressions, organize plan and manage every single day-to-day activity. Although there are different modes of communication, physical barrier…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Kumar Mridul , M. Ramanathan , Kunal Ahirwar , Mansi Sharma

Vision-Language Models (VLMs), with their strong reasoning and planning capabilities, are widely used in embodied decision-making (EDM) tasks in embodied agents, such as autonomous driving and robotic manipulation. Recent research has…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yichen Wang , Hangtao Zhang , Hewen Pan , Ziqi Zhou , Xianlong Wang , Peijin Guo , Lulu Xue , Shengshan Hu , Minghui Li , Leo Yu Zhang

Vision-Language Models (VLMs) have achieved remarkable progress in multimodal reasoning tasks through enhanced chain-of-thought capabilities. However, this advancement also introduces novel safety risks, as these models become increasingly…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yinan Xia , Yilei Jiang , Yingshui Tan , Xiaoyong Zhu , Xiangyu Yue , Bo Zheng

Retrieval Augmented Language Models (RALMs) have gained significant attention for their ability to generate accurate answer and improve efficiency. However, RALMs are inherently vulnerable to imperfect information due to their reliance on…

Computation and Language · Computer Science 2024-10-22 Seong-Il Park , Jay-Yoon Lee

Vision-Language Models (VLMs) are increasingly used as perceptual modules for visual content reasoning, including through captioning and DeepFake detection. In this work, we expose a critical vulnerability of VLMs when exposed to subtle,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Jordan Vice , Naveed Akhtar , Yansong Gao , Richard Hartley , Ajmal Mian