English
Related papers

Related papers: Labeling Out-of-View Objects in Immersive Analytic…

200 papers

This paper details a system for fast visual exploration and search without prior map information. We leverage frontier based planning with both LiDAR and visual sensing and augment it with a perception module that contextually labels points…

Robotics · Computer Science 2024-08-07 Ryan Gupta , Kyle Morgenstein , Steven Ortega , Luis Sentis

Highly dynamic environments, with moving objects such as cars or humans, can pose a performance challenge for LiDAR SLAM systems that assume largely static scenes. To overcome this challenge and support the deployment of robots in real…

High-quality labeled data is essential for training robust machine learning models, yet obtaining annotations at scale remains expensive. AI-assisted annotation has therefore become standard in large-scale labeling workflows. However, in…

Human-Computer Interaction · Computer Science 2026-05-13 Moussa Kassem Sbeyti , Joshua Holstein , Philipp Spitzer , Nadja Klein , Gerhard Satzger

This work strives for the classification and localization of human actions in videos, without the need for any labeled video training examples. Where existing work relies on transferring global attribute or object information from seen to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Pascal Mettes , William Thong , Cees G. M. Snoek

Supervised machine learning methods for image analysis require large amounts of labelled training data to solve computer vision problems. The recent rise of deep learning algorithms for recognising image content has led to the emergence of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Christoph Sager , Christian Janiesch , Patrick Zschech

Augmented Reality has been subject to various integration efforts within industries due to its ability to enhance human machine interaction and understanding. Neural networks have achieved remarkable results in areas of computer vision,…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 Linh Kästner , Daniel Dimitrov , Jens Lambrecht

Weakly-supervised learning approaches have gained significant attention due to their ability to reduce the effort required for human annotations in training neural networks. This paper investigates a framework for weakly-supervised object…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Byeongkeun Kang , Sinhae Cha , Yeejin Lee

Open World Object Detection (OWOD) is a novel computer vision task with a considerable challenge, bridging the gap between classic object detection (OD) benchmarks and real-world object detection. In addition to detecting and classifying…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Shuailei Ma , Yuefeng Wang , Ying Wei , Peihao Chen , Zhixiang Ye , Jiaqi Fan , Enming Zhang , Thomas H. Li

Object manipulation is a critical skill required for Embodied AI agents interacting with the world around them. Training agents to manipulate objects, poses many challenges. These include occlusion of the target object by the agent's arm,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Kiana Ehsani , Ali Farhadi , Aniruddha Kembhavi , Roozbeh Mottaghi

In Augmented Reality (AR) environment, realistic interactions between the virtual and real objects play a crucial role in user experience. Much of recent advances in AR has been largely focused on developing geometry-aware environment, but…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Long Chen , Karl Francis , Wen Tang

Physically rearranging objects is an important capability for embodied agents. Visual room rearrangement evaluates an agent's ability to rearrange objects in a room to a desired goal based solely on visual input. We propose a simple yet…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Brandon Trabucco , Gunnar Sigurdsson , Robinson Piramuthu , Gaurav S. Sukhatme , Ruslan Salakhutdinov

Unsupervised 3D object detection serves as an important solution for offline 3D object annotation. However, due to the data sparsity and limited views, the clustering-based label fitting in unsupervised object detection often generates…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Qiming Xia , Wenkai Lin , Haoen Xiang , Xun Huang , Siheng Chen , Zhen Dong , Cheng Wang , Chenglu Wen

Retrieval-augmented generation (RAG) with large language models (LLMs) plays a crucial role in question answering, as LLMs possess limited knowledge and are not updated with continuously growing information. Most recent work on RAG has…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shichao Kan , Yuhai Deng , Jiale Fu , Lihui Cen , Zhe Qu , Linna Zhang , Yixiong Liang , Yigang Cen

Immersive environments enable users to engage in embodied interaction, enhancing the sensemaking processes involved in completing tasks such as immersive analytics. Previous comparative studies on immersive analytics using augmented and…

Human-Computer Interaction · Computer Science 2024-04-08 Xiaoyan Zhou , Anil Ufuk Batmaz , Adam S. Williams , Dylan Schreiber , Francisco Ortega

We propose a system that learns to detect objects and infer their 3D poses in RGB-D images. Many existing systems can identify objects and infer 3D poses, but they heavily rely on human labels and 3D annotations. The challenge here is to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Mihir Prabhudesai , Shamit Lal , Hsiao-Yu Fish Tung , Adam W. Harley , Shubhankar Potdar , Katerina Fragkiadaki

Augmented reality technology has emerged as a promising solution to assist with wayfinding difficulties, bridging the gap between obtaining navigational assistance and maintaining an awareness of one's real-world surroundings. This article…

Human-Computer Interaction · Computer Science 2023-11-21 Zhiwen Qiu , Armin Mostafavi , Saleh Kalantari

After the introduction of smartphones and smartwatches, AR glasses are considered the next breakthrough in the field of wearables. While the transition from smartphones to smartwatches was based mainly on established display technologies,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Johannes Meyer

This paper presents a detailed study of improving visual representations for vision language (VL) tasks and develops an improved object detection model to provide object-centric representations of images. Compared to the most widely used…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Pengchuan Zhang , Xiujun Li , Xiaowei Hu , Jianwei Yang , Lei Zhang , Lijuan Wang , Yejin Choi , Jianfeng Gao

In many real-world settings, machine learning models need to identify user inputs that are out-of-domain (OOD) so as to avoid performing wrong actions. This work focuses on a challenging case of OOD detection, where no labels for in-domain…

Computation and Language · Computer Science 2022-03-23 Di Jin , Shuyang Gao , Seokhwan Kim , Yang Liu , Dilek Hakkani-Tur

Due to the increase of interest in Augmented Reality (AR), the potential uses of AR are increasing also. It can benefit the user in various fields such as education, business, medicine, and other. Augmented Reality supports the real…