English
Related papers

Related papers: Let Images Give You More:Point Cloud Cross-Modal T…

200 papers

Contrastive Language-Image Pre-training, benefiting from large-scale unlabeled text-image pairs, has demonstrated great performance in open-world vision understanding tasks. However, due to the limited Text-3D data pairs, adapting the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yihan Zeng , Chenhan Jiang , Jiageng Mao , Jianhua Han , Chaoqiang Ye , Qingqiu Huang , Dit-Yan Yeung , Zhen Yang , Xiaodan Liang , Hang Xu

It is counter-intuitive that multi-modality methods based on point cloud and images perform only marginally better or sometimes worse than approaches that solely use point cloud. This paper investigates the reason behind this phenomenon.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Wenwei Zhang , Zhe Wang , Chen Change Loy

Self-supervised learning can extract representations of good quality from solely unlabeled data, which is appealing for point cloud videos due to their high labelling cost. In this paper, we propose a contrastive mask prediction (PointCMP)…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Zhiqiang Shen , Xiaoxiao Sheng , Longguang Wang , Yulan Guo , Qiong Liu , Xi Zhou

Foundation models for point cloud data have recently grown in capability, often leveraging extensive representation learning from language or vision. In this work, we take a more controlled approach by introducing a lightweight…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Konrad Szafer , Marek Kraft , Dominik Belter

We present a simple and general framework for feature learning from point clouds. The key to the success of CNNs is the convolution operator that is capable of leveraging spatially-local correlation in data represented densely in grids…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Yangyan Li , Rui Bu , Mingchao Sun , Wei Wu , Xinhan Di , Baoquan Chen

Point clouds captured by scanning devices are often incomplete due to occlusion. To overcome this limitation, point cloud completion methods have been developed to predict the complete shape of an object based on its partial input. These…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Lintai Wu , Qijian Zhang , Junhui Hou , Yong Xu

The core of self-supervised point cloud learning lies in setting up appropriate pretext tasks, to construct a pre-training framework that enables the encoder to perceive 3D objects effectively. In this paper, we integrate two prevalent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Yun Liu , Peng Li , Xuefeng Yan , Liangliang Nan , Bing Wang , Honghua Chen , Lina Gong , Wei Zhao , Mingqiang Wei

Point clouds are a very efficient way to represent volumetric data in medical imaging. First, they do not occupy resources for empty spaces and therefore can avoid trade-offs between resolution and field-of-view for voxel-based 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Mattias Paul Heinrich

This paper presents a parameter-efficient prompt tuning method, named PPT, to adapt a large multi-modal model for 3D point cloud understanding. Existing strategies are quite expensive in computation and storage, and depend on time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Hongyu Sun , Yongcai Wang , Wang Chen , Haoran Deng , Deying Li

Point cloud classification refers to the process of assigning semantic labels or categories to individual points within a point cloud data structure. Recent works have explored the extension of pre-trained CLIP to 3D recognition. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Shuvozit Ghose , Yang Wang

Deep learning within the context of point clouds has gained much research interest in recent years mostly due to the promising results that have been achieved on a number of challenging benchmarks, such as 3D shape recognition and scene…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Ye Zhu , Sven Ewan Shepstone , Pablo Martínez-Nuevo , Miklas Strøm Kristoffersen , Fabien Moutarde , Zhuang Fu

Point cloud video representation learning is challenging due to complex structures and unordered spatial arrangement. Traditional methods struggle with frame-to-frame correlations and point-wise correspondence tracking. Recently, partial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Zhuoxu Huang , Zhenkun Fan , Tao Xu , Jungong Han

We present a deep learning method that propagates point-wise feature representations across shapes within a collection for the purpose of 3D shape segmentation. We propose a cross-shape attention mechanism to enable interactions between a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Marios Loizou , Siddhant Garg , Dmitry Petrov , Melinos Averkiou , Evangelos Kalogerakis

We propose a mechanism to reconstruct part annotated 3D point clouds of objects given just a single input image. We demonstrate that jointly training for both reconstruction and segmentation leads to improved performance in both the tasks,…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Priyanka Mandikal , Navaneet K L , R. Venkatesh Babu

Recently, a growing number of work design unsupervised paradigms for point cloud processing to alleviate the limitation of expensive manual annotation and poor transferability of supervised methods. Among them, CrossPoint follows the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Hongyu Sun , Yongcai Wang , Xudong Cai , Xuewei Bai , Deying Li

Zero-shot point cloud segmentation aims to make deep models capable of recognizing novel objects in point cloud that are unseen in the training phase. Recent trends favor the pipeline which transfers knowledge from seen classes with labels…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yuhang Lu , Qi Jiang , Runnan Chen , Yuenan Hou , Xinge Zhu , Yuexin Ma

In the field of autonomous driving, a variety of sensor data types exist, each representing different modalities of the same scene. Therefore, it is feasible to utilize data from other sensors to facilitate image compression. However, few…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Yiheng Jiang , Haotian Zhang , Li Li , Dong Liu , Zhu Li

Data augmentation is an effective regularization strategy for mitigating overfitting in deep neural networks, and it plays a crucial role in 3D vision tasks, where the point cloud data is relatively limited. While mixing-based augmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Yi Wang , Jiaze Wang , Jinpeng Li , Zixu Zhao , Guangyong Chen , Anfeng Liu , Pheng-Ann Heng

The matching of 3D shapes has been extensively studied for shapes represented as surface meshes, as well as for shapes represented as point clouds. While point clouds are a common representation of raw real-world 3D data (e.g. from laser…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Dongliang Cao , Florian Bernard

Metric-based meta-learning techniques have successfully been applied to few-shot classification problems. In this paper, we propose to leverage cross-modal information to enhance metric-based few-shot learning methods. Visual and semantic…

Machine Learning · Computer Science 2020-02-19 Chen Xing , Negar Rostamzadeh , Boris N. Oreshkin , Pedro O. Pinheiro