English
Related papers

Related papers: PointVST: Self-Supervised Pre-training for 3D Poin…

200 papers

The success of supervised learning requires large-scale ground truth labels which are very expensive, time-consuming, or may need special skills to annotate. To address this issue, many self- or un-supervised methods are developed. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Longlong Jing , Yucheng Chen , Ling Zhang , Mingyi He , Yingli Tian

In recent years, point cloud representation has become one of the research hotspots in the field of computer vision, and has been widely used in many fields, such as autonomous driving, virtual reality, robotics, etc. Although deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Huang Zhang , Changshuo Wang , Shengwei Tian , Baoli Lu , Liping Zhang , Xin Ning , Xiao Bai

Point cloud analysis (such as 3D segmentation and detection) is a challenging task, because of not only the irregular geometries of many millions of unordered points, but also the great variations caused by depth, viewpoint, occlusion, etc.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Tuo Feng , Wenguan Wang , Xiaohan Wang , Yi Yang , Qinghua Zheng

Recent advances in multi-modal pre-training methods have shown promising effectiveness in learning 3D representations by aligning multi-modal features between 3D shapes and their corresponding 2D counterparts. However, existing multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Liwen Liu , Weidong Yang , Lipeng Ma , Ben Fei

Recent vision-language models (VLMs) such as CLIP demonstrate impressive cross-modal reasoning, extending beyond images to 3D perception. Yet, these models remain fragile under domain shifts, especially when adapting from synthetic to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Mainak Singha , Sarthak Mehrotra , Paolo Casari , Subhasis Chaudhuri , Elisa Ricci , Biplab Banerjee

This paper introduces a novel approach named CrossVideo, which aims to enhance self-supervised cross-modal contrastive learning in the field of point cloud video understanding. Traditional supervised learning methods encounter limitations…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Yunze Liu , Changxi Chen , Zifan Wang , Li Yi

Large-scale vision 2D vision language models, such as CLIP can be aligned with a 3D encoder to learn generalizable (open-vocabulary) 3D vision models. However, current methods require supervised pre-training for such alignment, and the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Amaya Dharmasiri , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan

Self-supervised methods have been proven effective for learning deep representations of 3D point cloud data. Although recent methods in this domain often rely on random masking of inputs, the results of this approach can be improved. We…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Michał Szachniewicz , Wojciech Kozłowski , Michał Stypułkowski , Maciej Zięba

3D point cloud semantic segmentation is a challenging topic in the computer vision field. Most of the existing methods in literature require a large amount of fully labeled training data, but it is extremely time-consuming to obtain these…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Shuang Deng , Qiulei Dong , Bo Liu , Zhanyi Hu

Automatic synthesis of high quality 3D shapes is an ongoing and challenging area of research. While several data-driven methods have been proposed that make use of neural networks to generate 3D shapes, none of them reach the level of…

Computer Vision and Pattern Recognition · Computer Science 2019-06-28 Isaak Lim , Moritz Ibing , Leif Kobbelt

Weakly supervised point cloud semantic segmentation methods that require 1\% or fewer labels, hoping to realize almost the same performance as fully supervised approaches, which recently, have attracted extensive research attention. A…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Tianfang Sun , Zhizhong Zhang , Xin Tan , Yanyun Qu , Yuan Xie , Lizhuang Ma

Geometry and color information provided by the point clouds are both crucial for 3D scene understanding. Two pieces of information characterize the different aspects of point clouds, but existing methods lack an elaborate design for the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Guofan Fan , Zekun Qi , Wenkai Shi , Kaisheng Ma

Recently, a growing number of work design unsupervised paradigms for point cloud processing to alleviate the limitation of expensive manual annotation and poor transferability of supervised methods. Among them, CrossPoint follows the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Hongyu Sun , Yongcai Wang , Xudong Cai , Xuewei Bai , Deying Li

Introducing BERT into cross-modal settings raises difficulties in its optimization for handling multiple modalities. Both the BERT architecture and training objective need to be adapted to incorporate and model information from different…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Xin Li , Peng Li , Zeyong Wei , Zhe Zhu , Mingqiang Wei , Junhui Hou , Liangliang Nan , Jing Qin , Haoran Xie , Fu Lee Wang

The remarkable breakthroughs in point cloud representation learning have boosted their usage in real-world applications such as self-driving cars and virtual reality. However, these applications usually have an urgent requirement for not…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Linfeng Zhang , Runpei Dong , Hung-Shuo Tai , Kaisheng Ma

3D point cloud analysis has drawn a lot of research attention due to its wide applications. However, collecting massive labelled 3D point cloud data is both time-consuming and labor-intensive. This calls for data-efficient learning methods.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Fayao Liu , Guosheng Lin , Chuan-Sheng Foo , Chaitanya K. Joshi , Jie Lin

Point cloud based 3D deep model has wide applications in many applications such as autonomous driving, house robot, and so on. Inspired by the recent prompt learning in natural language processing, this work proposes a novel Multi-view…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Haoyang Peng , Baopu Li , Bo Zhang , Xin Chen , Tao Chen , Hongyuan Zhu

In the recent years, the research community has witnessed growing use of 3D point cloud data for the high applicability in various real-world applications. By means of 3D point cloud, this modality enables to consider the actual size and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Daichi Otsuka , Shinichi Mae , Ryosuke Yamada , Hirokatsu Kataoka

Understanding the 3D world without supervision is currently a major challenge in computer vision as the annotations required to supervise deep networks for tasks in this domain are expensive to obtain on a large scale. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

3D perception in LiDAR point clouds is crucial for a self-driving vehicle to properly act in 3D environment. However, manually labeling point clouds is hard and costly. There has been a growing interest in self-supervised pre-training of 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Mu Cai , Chenxu Luo , Yong Jae Lee , Xiaodong Yang