English
Related papers

Related papers: Contrastive Lift: 3D Object Instance Segmentation …

200 papers

We propose a novel method for instance label segmentation of dense 3D voxel grids. We target volumetric scene representations, which have been acquired with depth sensors or multi-view stereo methods and which have been processed with…

Computer Vision and Pattern Recognition · Computer Science 2019-11-04 Jean Lahoud , Bernard Ghanem , Marc Pollefeys , Martin R. Oswald

We propose an approach to instance segmentation from 3D point clouds based on dynamic convolution. This enables it to adapt, at inference, to varying feature and object scales. Doing so avoids some pitfalls of bottom up approaches,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Tong He , Chunhua Shen , Anton van den Hengel

This paper studies the 3D instance segmentation problem, which has a variety of real-world applications such as robotics and augmented reality. Since the surroundings of 3D objects are of high complexity, the separating of different objects…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Min Zhong , Xinghao Chen , Xiaokang Chen , Gang Zeng , Yunhe Wang

We study the problem of self-supervised 3D scene flow estimation from real large-scale raw point cloud sequences, which is crucial to various tasks like trajectory prediction or instance segmentation. In the absence of ground truth scene…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Patrik Vacek , David Hurych , Tomáš Svoboda , Karel Zimmermann

Despite rapid progress in scene segmentation in recent years, 3D segmentation methods are still limited when there is severe occlusion. The key challenge is estimating the segment boundaries of (partially) occluded objects, which are…

Robotics · Computer Science 2021-04-02 Andrew Price , Kun Huang , Dmitry Berenson

Unsupervised 3D instance segmentation aims to segment objects from a 3D point cloud without any annotations. Existing methods face the challenge of either too loose or too tight clustering, leading to under-segmentation or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Cheng Shi , Yulin Zhang , Bin Yang , Jiajin Tang , Yuexin Ma , Sibei Yang

Existing 3D instance segmentation methods frequently encounter issues with over-segmentation, leading to redundant and inaccurate 3D proposals that complicate downstream tasks. This challenge arises from their unsupervised merging approach,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Phuc Nguyen , Minh Luu , Anh Tran , Cuong Pham , Khoi Nguyen

LiDAR and camera fusion techniques are promising for achieving 3D object detection in autonomous driving. Most multi-modal 3D object detection frameworks integrate semantic knowledge from 2D images into 3D LiDAR point clouds to enhance…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shaoqing Xu , Fang Li , Ziying Song , Jin Fang , Sifen Wang , Zhi-Xin Yang

Instance segmentation is an important task for scene understanding. Compared to the fully-developed 2D, 3D instance segmentation for point clouds have much room to improve. In this paper, we present PointGroup, a new end-to-end bottom-up…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Li Jiang , Hengshuang Zhao , Shaoshuai Shi , Shu Liu , Chi-Wing Fu , Jiaya Jia

The widespread adoption of autonomous systems such as drones and assistant robots has created a need for real-time high-quality semantic scene segmentation. In this paper, we propose an efficient yet robust technique for on-the-fly dense…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Quang-Hieu Pham , Binh-Son Hua , Duc Thanh Nguyen , Sai-Kit Yeung

Humans can naturally identify and mentally complete occluded objects in cluttered environments. However, imparting similar cognitive ability to robotics remains challenging even with advanced reconstruction techniques, which models scenes…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Zesong Yang , Bangbang Yang , Wenqi Dong , Chenxuan Cao , Liyuan Cui , Yuewen Ma , Zhaopeng Cui , Hujun Bao

Instance segmentation on point clouds is a fundamental task in 3D scene perception. In this work, we propose a concise clustering-based framework named HAIS, which makes full use of spatial relation of points and point sets. Considering…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Shaoyu Chen , Jiemin Fang , Qian Zhang , Wenyu Liu , Xinggang Wang

Computer vision is largely based on 2D techniques, with 3D vision still relegated to a relatively narrow subset of applications. However, by building on recent advances in 3D models such as neural radiance fields, some authors have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Vadim Tschernezki , Diane Larlus , Iro Laina , Andrea Vedaldi

Reliable 3D segmentation is critical for understanding complex scenes with dense layouts and multi-scale objects, as commonly seen in industrial environments. In such scenarios, heavy occlusion weakens geometric boundaries between objects,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yu Zhu , Naoya Chiba , Koichi Hashimoto

Class-agnostic 3D instance segmentation tackles the challenging task of segmenting all object instances, including previously unseen ones, without semantic class reliance. Current methods struggle with generalization due to the scarce…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Shengchao Zhou , Jiehong Lin , Jiahui Liu , Shizhen Zhao , Chirui Chang , Xiaojuan Qi

Locating and retrieving objects from scene-level point clouds is a challenging problem with broad applications in robotics and augmented reality. This task is commonly formulated as open-vocabulary 3D instance segmentation. Although recent…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Khanh Nguyen , Dasith de Silva Edirimuni , Ghulam Mubashar Hassan , Ajmal Mian

3D point cloud segmentation has a wide range of applications in areas such as autonomous driving, augmented reality, virtual reality and digital twins. The point cloud data collected in real scenes often contain small objects and categories…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Chade Li , Pengju Zhang , Jiaming Zhang , Yihong Wu

Multimodal 3D object detection based on deep neural networks has indeed made significant progress. However, it still faces challenges due to the misalignment of scale and spatial information between features extracted from 2D images and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Bonan Ding , Jin Xie , Jing Nie , Jiale Cao

We propose an interactive approach for 3D instance segmentation, where users can iteratively collaborate with a deep learning model to segment objects in a 3D point cloud directly. Current methods for 3D instance segmentation are generally…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Theodora Kontogianni , Ekin Celikkan , Siyu Tang , Konrad Schindler

Instance segmentation aims to delineate each individual object of interest in an image. State-of-the-art approaches achieve this goal by either partitioning semantic segmentations or refining coarse representations of detected objects. In…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Long Chen , Yuli Wu , Dorit Merhof