English
Related papers

Related papers: SegVec3D: A Method for Vector Embedding of 3D Obje…

200 papers

Current 3D scene segmentation methods are heavily dependent on manually annotated 3D training datasets. Such manual annotations are labor-intensive, and often lack fine-grained details. Importantly, models trained on this data typically…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Rui Huang , Songyou Peng , Ayca Takmaz , Federico Tombari , Marc Pollefeys , Shiji Song , Gao Huang , Francis Engelmann

3D instance segmentation plays a crucial role in comprehending 3D scenes. Despite recent advancements in this field, existing approaches exhibit certain limitations. These methods often rely on fixed instance positions obtained from sampled…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Mengnan Zhao , Lihe Zhang , Yuqiu Kong , Baocai Yin

3D object detection using LiDAR data is an indispensable component for autonomous driving systems. Yet, only a few LiDAR-based 3D object detection methods leverage segmentation information to further guide the detection process. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Hamidreza Fazlali , Yixuan Xu , Yuan Ren , Bingbing Liu

3D scene understanding is crucial for facilitating seamless interaction between digital devices and the physical world. Real-time capturing and processing of the 3D scene are essential for achieving this seamless integration. While existing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Remco Royen , Kostas Pataridis , Ward van der Tempel , Adrian Munteanu

3D point cloud semantic segmentation is a challenging topic in the computer vision field. Most of the existing methods in literature require a large amount of fully labeled training data, but it is extremely time-consuming to obtain these…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Shuang Deng , Qiulei Dong , Bo Liu , Zhanyi Hu

We present an improved approach for 3D object detection in point cloud data based on the Frustum PointNet (F-PointNet). Compared to the original F-PointNet, our newly proposed method considers the point neighborhood when computing point…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Chengzhi Wu , Julius Pfrommer , Jürgen Beyerer , Kangning Li , Boris Neubert

In this paper, we investigate Open-Vocabulary 3D Instance Segmentation (OV-3DIS) with free-form language instructions. Earlier works that rely on only annotated base categories for training suffer from limited generalization to unseen novel…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Seungjun Lee , Yuyang Zhao , Gim Hee Lee

The objective of this paper is self-supervised learning of video object segmentation. We develop a unified framework which simultaneously models cross-frame dense correspondence for locally discriminative feature learning and embeds…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Liulei Li , Wenguan Wang , Tianfei Zhou , Jianwu Li , Yi Yang

We introduce Open3DIS, a novel solution designed to tackle the problem of Open-Vocabulary Instance Segmentation within 3D scenes. Objects within 3D environments exhibit diverse shapes, scales, and colors, making precise instance-level…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Phuc D. A. Nguyen , Tuan Duc Ngo , Evangelos Kalogerakis , Chuang Gan , Anh Tran , Cuong Pham , Khoi Nguyen

Existing point-cloud based 3D object detectors use convolution-like operators to process information in a local neighbourhood with fixed-weight kernels and aggregate global context hierarchically. However, non-local neural networks and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Prarthana Bhattacharyya , Chengjie Huang , Krzysztof Czarnecki

Realizing unified 3D object detection, including both indoor and outdoor scenes, holds great importance in applications like robot navigation. However, involving various scenarios of data to train models poses challenges due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zhuoling Li , Xiaogang Xu , SerNam Lim , Hengshuang Zhao

Point cloud registration is a foundational task for 3D alignment and reconstruction applications. While both traditional and learning-based registration approaches have succeeded, leveraging the intrinsic symmetry of point cloud data,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Xueyang Kang , Zhaoliang Luan , Kourosh Khoshelham , Bing Wang

We present a novel embedding approach for video instance segmentation. Our method learns a spatio-temporal embedding integrating cues from appearance, motion, and geometry; a 3D causal convolutional network models motion, and a monocular…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Anthony Hu , Alex Kendall , Roberto Cipolla

Semantic segmentation of raw 3D point clouds is an essential component in 3D scene analysis, but it poses several challenges, primarily due to the non-Euclidean nature of 3D point clouds. Although, several deep learning based approaches…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Saqib Ali Khan , Yilei Shi , Muhammad Shahzad , Xiao Xiang Zhu

Semantic vector embedding techniques have proven useful in learning semantic representations of data across multiple domains. A key application enabled by such techniques is the ability to measure semantic similarity between given data…

Computation and Language · Computer Science 2020-09-01 Shalisha Witherspoon , Dean Steuer , Graham Bent , Nirmit Desai

Semantic, instance, and panoptic segmentation of 3D point clouds have been addressed using task-specific models of distinct design. Thereby, the similarity of all segmentation tasks and the implicit relationship between them have not been…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Maxim Kolodiazhnyi , Anna Vorontsova , Anton Konushin , Danila Rukhovich

We propose a method for unsupervised video object segmentation by transferring the knowledge encapsulated in image-based instance embedding networks. The instance embedding network produces an embedding vector for each pixel that enables…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Siyang Li , Bryan Seybold , Alexey Vorobyov , Alireza Fathi , Qin Huang , C. -C. Jay Kuo

3D point clouds are rich in geometric structure information, while 2D images contain important and continuous texture information. Combining 2D information to achieve better 3D semantic segmentation has become mainstream in 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Chaolong Yang , Yuyao Yan , Weiguang Zhao , Jianan Ye , Xi Yang , Amir Hussain , Kaizhu Huang

3D object detection plays an important role in a large number of real-world applications. It requires us to estimate the localizations and the orientations of 3D objects in real scenes. In this paper, we present a new network architecture…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Xin Zhao , Zhe Liu , Ruolan Hu , Kaiqi Huang

In the field of resource-constrained robots and the need for effective place recognition in multi-robotic systems, this article introduces RecNet, a novel approach that concurrently addresses both challenges. The core of RecNet's…

Robotics · Computer Science 2024-10-04 Nikolaos Stathoulopoulos , Mario A. V. Saucedo , Anton Koval , George Nikolakopoulos