English
Related papers

Related papers: Real-time 3D Semantic Scene Perception for Egocent…

200 papers

To be useful in everyday environments, robots must be able to identify and locate real-world objects. In recent years, video object segmentation has made significant progress on densely separating such objects from background in real and…

Robotics · Computer Science 2020-01-13 Brent A. Griffin , Victoria Florence , Jason J. Corso

3D point clouds play a pivotal role in outdoor scene perception, especially in the context of autonomous driving. Recent advancements in 3D LiDAR segmentation often focus intensely on the spatial positioning and distribution of points for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Li Li , Hubert P. H. Shum , Toby P. Breckon

Recognition of occluded objects in unseen indoor environments is a challenging problem for mobile robots. This work proposes a new slicing-based topological descriptor that captures the 3D shape of object point clouds to address this…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Ekta U. Samani , Ashis G. Banerjee

Object segmentation in infant's egocentric videos is a fundamental step in studying how children perceive objects in early stages of development. From the computer vision perspective, object segmentation in such videos pose quite a few…

Computer Vision and Pattern Recognition · Computer Science 2016-02-09 Qazaleh Mirsharif , Sidharth Sadani , Shishir Shah , Hanako Yoshida , Joseph Burling

Detecting 3D objects from a single RGB image is intrinsically ambiguous, thus requiring appropriate prior knowledge and intermediate representations as constraints to reduce the uncertainties and improve the consistencies between the 2D…

Computer Vision and Pattern Recognition · Computer Science 2019-12-18 Siyuan Huang , Yixin Chen , Tao Yuan , Siyuan Qi , Yixin Zhu , Song-Chun Zhu

Open-vocabulary 3D scene understanding is pivotal for enhancing physical intelligence, as it enables embodied agents to interpret and interact dynamically within real-world environments. This paper introduces MPEC, a novel Masked…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Yan Wang , Baoxiong Jia , Ziyu Zhu , Siyuan Huang

Three-dimensional (3D) point cloud analysis has become one of the attractive subjects in realistic imaging and machine visions due to its simplicity, flexibility and powerful capacity of visualization. Actually, the representation of scenes…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Omar Elharrouss , Kawther Hassine , Ayman Zayyan , Zakariyae Chatri , Noor almaadeed , Somaya Al-Maadeed , Khalid Abualsaud

Accurate perception of dynamic traffic scenes is crucial for high-level autonomous driving systems, requiring robust object motion estimation and instance segmentation. However, traditional methods often treat them as separate tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yinqi Chen , Meiying Zhang , Qi Hao , Guang Zhou

This article presents a 3D point cloud map-merging framework for egocentric heterogeneous multi-robot exploration, based on overlap detection and alignment, that is independent of a manual initial guess or prior knowledge of the robots'…

In the field of SLAM (Simultaneous Localization And Mapping) for robot navigation, mapping the environment is an important task. In this regard the Lidar sensor can produce near accurate 3D map of the environment in the format of point…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Aritra Mukherjee , Sourya Dipta Das , Jasorsi Ghosh , Ananda S. Chowdhury , Sanjoy Kumar Saha

4D LiDAR semantic segmentation, also referred to as multi-scan semantic segmentation, plays a crucial role in enhancing the environmental understanding capabilities of autonomous vehicles or robots. It classifies the semantic category of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Neng Wang , Ruibin Guo , Chenghao Shi , Ziyue Wang , Hui Zhang , Huimin Lu , Zhiqiang Zheng , Xieyuanli Chen

In depth-sensing applications ranging from home robotics to AR/VR, it will be common to acquire 3D scans of interior spaces repeatedly at sparse time intervals (e.g., as part of regular daily use). We propose an algorithm that analyzes…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Maciej Halber , Yifei Shi , Kai Xu , Thomas Funkhouser

We present a novel object detection pipeline for localization and recognition in three dimensional environments. Our approach makes use of an RGB-D sensor and combines state-of-the-art techniques from the robotics and computer vision…

Robotics · Computer Science 2017-03-16 Alexander Broad , Brenna Argall

Efficient RGB-D semantic segmentation has received considerable attention in mobile robots, which plays a vital role in analyzing and recognizing environmental information. According to previous studies, depth information can provide…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yang Zhang , Chenyun Xiong , Junjie Liu , Xuhui Ye , Guodong Sun

Semantic understanding of 3D point clouds is important for various robotics applications. Given that point-wise semantic annotation is expensive, in this paper, we address the challenge of learning models with extremely sparse labels. The…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Liyi Luo , Beiwen Tian , Hao Zhao , Guyue Zhou

Semantic scene completion is the task of predicting a complete 3D representation of volumetric occupancy with corresponding semantic labels for a scene from a single point of view. Previous works on Semantic Scene Completion from RGB-D data…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Aloisio Dourado , Teofilo Emidio de Campos , Hansung Kim , Adrian Hilton

Semantic scene understanding is essential for mobile agents acting in various environments. Although semantic segmentation already provides a lot of information, details about individual objects as well as the general scene are missing but…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Daniel Seichter , Söhnke Benedikt Fischedick , Mona Köhler , Horst-Michael Groß

Depth estimation is a core problem in robotic perception and vision tasks, but 3D reconstruction from a single image presents inherent uncertainties. Current depth estimation models primarily rely on inter-image relationships for supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Jinchang Zhang , Guoyu Lu

We propose a system that learns to detect objects and infer their 3D poses in RGB-D images. Many existing systems can identify objects and infer 3D poses, but they heavily rely on human labels and 3D annotations. The challenge here is to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Mihir Prabhudesai , Shamit Lal , Hsiao-Yu Fish Tung , Adam W. Harley , Shubhankar Potdar , Katerina Fragkiadaki

Recent approaches have successfully focused on the segmentation of static reconstructions, thereby equipping downstream applications with semantic 3D understanding. However, the world in which we live is dynamic, characterized by numerous…

Robotics · Computer Science 2025-03-12 Tjark Behrens , René Zurbrügg , Marc Pollefeys , Zuria Bauer , Hermann Blum