English
Related papers

Related papers: Instance-aware 3D Semantic Segmentation powered by…

200 papers

We propose SegVec3D, a novel framework for 3D point cloud instance segmentation that integrates attention mechanisms, embedding learning, and cross-modal alignment. The approach builds a hierarchical feature extractor to enhance geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Zhihan Kang , Boyu Wang

We propose an efficient and scalable method for incrementally building a dense, semantically annotated 3D map in real-time. The proposed method assigns class probabilities to each region, not each element (e.g., surfel and voxel), of the 3D…

Computer Vision and Pattern Recognition · Computer Science 2018-03-08 Yoshikatsu Nakajima , Keisuke Tateno , Federico Tombari , Hideo Saito

We present PartNet: a consistent, large-scale dataset of 3D objects annotated with fine-grained, instance-level, and hierarchical 3D part information. Our dataset consists of 573,585 part instances over 26,671 3D models covering 24 object…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Kaichun Mo , Shilin Zhu , Angel X. Chang , Li Yi , Subarna Tripathi , Leonidas J. Guibas , Hao Su

Learning implicit templates as neural fields has recently shown impressive performance in unsupervised shape correspondence. Despite the success, we observe current approaches, which solely rely on geometric information, often learn…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Sihyeon Kim , Minseok Joo , Jaewon Lee , Juyeon Ko , Juhan Cha , Hyunwoo J. Kim

Instance segmentation is of great importance for many biological applications, such as study of neural cell interactions, plant phenotyping, and quantitatively measuring how cells react to drug treatment. In this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Jingru Yi , Pengxiang Wu , Hui Tang , Bo Liu , Qiaoying Huang , Hui Qu , Lianyi Han , Wei Fan , Daniel J. Hoeppner , Dimitris N. Metaxas

Image segmentation is often ambiguous at the level of individual image patches and requires contextual information to reach label consensus. In this paper we introduce Segmenter, a transformer model for semantic segmentation. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Robin Strudel , Ricardo Garcia , Ivan Laptev , Cordelia Schmid

Large-scale datasets with point-wise semantic and instance labels are crucial to 3D instance segmentation but also expensive. To leverage unlabeled data, previous semi-supervised 3D instance segmentation approaches have explored…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yizheng Wu , Zhiyu Pan , Kewei Wang , Xingyi Li , Jiahao Cui , Liwen Xiao , Guosheng Lin , Zhiguo Cao

Perceiving a three-dimensional (3D) scene with multiple objects while moving indoors is essential for vision-based mobile cobots, especially for enhancing their manipulation tasks. In this work, we present an end-to-end pipeline with…

Robotics · Computer Science 2024-02-20 K. Nguyen , T. Dang , M. Huber

Reliable 3D segmentation is critical for understanding complex scenes with dense layouts and multi-scale objects, as commonly seen in industrial environments. In such scenarios, heavy occlusion weakens geometric boundaries between objects,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yu Zhu , Naoya Chiba , Koichi Hashimoto

We tackle the problem of learning an implicit scene representation for 3D instance segmentation from a sequence of posed RGB images. Towards this, we introduce 3DIML, a novel framework that efficiently learns a neural label field which can…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 George Tang , Krishna Murthy Jatavallabhula , Antonio Torralba

Recently, methods have been proposed for 3D open-vocabulary semantic segmentation. Such methods are able to segment scenes into arbitrary classes based on text descriptions provided during runtime. In this paper, we propose to the best of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Haoran Chen , Kenneth Blomqvist , Francesco Milano , Roland Siegwart

Representing 3D shape is a fundamental problem in artificial intelligence, which has numerous applications within computer vision and graphics. One avenue that has recently begun to be explored is the use of latent representations of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tristan Aumentado-Armstrong , Stavros Tsogkas , Allan Jepson , Sven Dickinson

By estimating 3D shape and instances from a single view, we can capture information about an environment quickly, without the need for comprehensive scanning and multi-view fusion. Solving this task for composite scenes (such as object…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Zoe Landgraf , Raluca Scona , Tristan Laidlow , Stephen James , Stefan Leutenegger , Andrew J. Davison

Semantic segmentation is still a challenging task for parsing diverse contexts in different scenes, thus the fixed classifier might not be able to well address varying feature distributions during testing. Different from the mainstream…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Zhuotao Tian , Jiequan Cui , Li Jiang , Xiaojuan Qi , Xin Lai , Yixin Chen , Shu Liu , Jiaya Jia

This paper introduces a novel approach to learning instance segmentation using extreme points, i.e., the topmost, leftmost, bottommost, and rightmost points, of each object. These points are readily available in the modern bounding box…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Hyeonjun Lee , Sehyun Hwang , Suha Kwak

Compared to many other dense prediction tasks, e.g., semantic segmentation, it is the arbitrary number of instances that has made instance segmentation much more challenging. In order to predict a mask for each instance, mainstream…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Xinlong Wang , Rufeng Zhang , Chunhua Shen , Tao Kong , Lei Li

Current advances in deep learning is leading to human-level accuracy in computer vision tasks such as object classification, localization, semantic segmentation, and instance segmentation. In this paper, we describe a new deep convolutional…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 N. Lakmal Deshapriya , Matthew N. Dailey , Manzul Kumar Hazarika , Hiroyuki Miyazaki

We introduce an online 2D-to-3D semantic instance mapping algorithm aimed at generating comprehensive, accurate, and efficient semantic 3D maps suitable for autonomous agents in unstructured environments. The proposed approach is based on a…

Robotics · Computer Science 2024-07-09 Yang Miao , Iro Armeni , Marc Pollefeys , Daniel Barath

We propose a method for instance-level segmentation that uses RGB-D data as input and provides detailed information about the location, geometry and number of individual objects in the scene. This level of understanding is fundamental for…

Robotics · Computer Science 2018-09-20 Lin Shao , Ye Tian , Jeannette Bohg

Semantic segmentation, which aims to classify every pixel in an image, is a key task in machine perception, with many applications across robotics and autonomous driving. Due to the high dimensionality of this task, most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Alex Zihao Zhu , Jieru Mei , Siyuan Qiao , Hang Yan , Yukun Zhu , Liang-Chieh Chen , Henrik Kretzschmar