English
Related papers

Related papers: Semantic Augmented Reality Environment with Materi…

200 papers

Lighting understanding plays an important role in virtual object composition, including mobile augmented reality (AR) applications. Prior work often targets recovering lighting from the physical environment to support photorealistic AR…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yiqin Zhao , Sean Fanello , Tian Guo

We present RealitySketch, an augmented reality interface for sketching interactive graphics and visualizations. In recent years, an increasing number of AR sketching tools enable users to draw and embed sketches in the real world. However,…

Human-Computer Interaction · Computer Science 2020-08-21 Ryo Suzuki , Rubaiat Habib Kazi , Li-Yi Wei , Stephen DiVerdi , Wilmot Li , Daniel Leithinger

In this paper, we introduce a novel system designed to enhance customer service in the financial and retail sectors through a context-aware 3D virtual agent, utilizing Mixed Reality (MR) and Vision Language Models (VLMs). Our approach…

Human-Computer Interaction · Computer Science 2024-10-17 Cindy Xu , Mengyu Chen , Pranav Deshpande , Elvir Azanli , Runqing Yang , Joseph Ligman

Immersive environments enable users to engage in embodied interaction, enhancing the sensemaking processes involved in completing tasks such as immersive analytics. Previous comparative studies on immersive analytics using augmented and…

Human-Computer Interaction · Computer Science 2024-04-08 Xiaoyan Zhou , Anil Ufuk Batmaz , Adam S. Williams , Dylan Schreiber , Francisco Ortega

3D generation and reconstruction techniques have been widely used in computer games, film, and other content creation areas. As the application grows, there is a growing demand for 3D shapes that look truly realistic. Traditional evaluation…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Sheng Liu , Tianyu Luan , Phani Nuney , Xuelu Feng , Junsong Yuan

Semantic SLAM is an important field in autonomous driving and intelligent agents, which can enable robots to achieve high-level navigation tasks, obtain simple cognition or reasoning ability and achieve language-based…

Robotics · Computer Science 2020-01-07 Zirui Zhao , Yijun Mao , Yan Ding , Pengju Ren , Nanning Zheng

Incorporating the physical environment is essential for a complete understanding of human behavior in unconstrained every-day tasks. This is especially important in ego-centric tasks where obtaining 3 dimensional information is both…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Mickey Li , Noyan Songur , Pavel Orlov , Stefan Leutenegger , A Aldo Faisal

Simulation engines are widely adopted in robotics. However, they lack either full simulation control, ROS integration, realistic physics, or photorealism. Recently, synthetic data generation and realistic rendering has advanced tasks like…

Robotics · Computer Science 2023-05-29 Elia Bonetto , Chenghao Xu , Aamir Ahmad

This research seeks to explore how Augmented Reality (AR) can support learning psychomotor tasks that involve complex manipulation and reasoning processes. The AR prototype was created using Unity and used on HoloLens 2 headsets. Here, we…

Human-Computer Interaction · Computer Science 2023-05-18 Dong Woo Yoo , Sakib Reza , Nicholas Wilson , Kemi Jona , Mohsen Moghaddam

We present a real-time semantic mapping approach for mobile vision systems with a 2D to 3D object detection pipeline and rapid data association for generated landmarks. Besides the semantic map enrichment the associated detections are…

Robotics · Computer Science 2022-03-25 Thorsten Hempel , Ayoub Al-Hamadi

Augmented Reality (AR) provides a safe and low-cost option for hazardous safety training that allows for the visualization of aspects that may be invisible, such as radiation. Effectively visually communicating such threats in the…

Human-Computer Interaction · Computer Science 2024-03-11 Fintan McGee , Roderick McCall , Joan Baixauli

Creating realistic virtual assets is a time-consuming process: it usually involves an artist designing the object, then spending a lot of effort on tweaking its appearance. Intricate details and certain effects, such as subsurface…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Aljaž Božič , Denis Gladkov , Luke Doukakis , Christoph Lassner

Site-specific outdoor AR experiences are typically authored using static 3D models, but are deployed in physical environments that change over time. As a result, virtual content may become misaligned with its intended real-world referents,…

Human-Computer Interaction · Computer Science 2025-08-12 Nels Numan , Jessica Van Brummelen , Ziwen Lu , Anthony Steed

This position paper presents the AR Language Map, a speculative artifact designed to enhance understanding of linguistic justice among middle and high school students through augmented reality (AR) that allows students to map their…

Human-Computer Interaction · Computer Science 2024-04-22 Ashvini Varatharaj , Abigail Welch , Mary Bucholtz , Jin Sook Lee

We provide an experimental evaluation of a wearable augmented reality (AR) system we have developed for human-robot teams working on tasks requiring collaboration in shared physical workspace. Recent advances in AR technology have…

Providing pedestrians and other vulnerable road users with a clear indication about a fully autonomous vehicle status and intentions is crucial to make them coexist. In the last few years, a variety of external interfaces have been…

Human-Computer Interaction · Computer Science 2021-02-05 F. Gabriele Pratticò , Fabrizio Lamberti , Alberto Cannavò , Lia Morra , Paolo Montuschi

The concept of 3D scene graphs is increasingly recognized as a powerful semantic and hierarchical representation of the environment. Current approaches often address this at a coarse, object-level resolution. In contrast, our goal is to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Dennis Rotondi , Fabio Scaparro , Hermann Blum , Kai O. Arras

We discuss and predict the evolution of Simultaneous Localisation and Mapping (SLAM) into a general geometric and semantic `Spatial AI' perception capability for intelligent embodied devices. A big gap remains between the visual perception…

Artificial Intelligence · Computer Science 2018-04-02 Andrew J. Davison

Well-designed indoor scenes should prioritize how people can act within a space rather than merely what objects to place. However, existing 3D scene generation methods emphasize visual and semantic plausibility, while insufficiently…

Human-Computer Interaction · Computer Science 2026-03-04 Semin Jin , Donghyuk Kim , Jeongmin Ryu , Kyung Hoon Hyun

Augmented reality (AR) is one of the relatively old, yet trending areas in the intersection of computer vision and computer graphics with numerous applications in several areas, from gaming and entertainment, to education and healthcare.…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Shervin Minaee , Xiaodan Liang , Shuicheng Yan