English
Related papers

Related papers: Self-Supervised Learning with Multi-View Rendering…

200 papers

With the overwhelming trend of mask image modeling led by MAE, generative pre-training has shown a remarkable potential to boost the performance of fundamental models in 2D vision. However, in 3D vision, the over-reliance on…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Ziyi Wang , Xumin Yu , Yongming Rao , Jie Zhou , Jiwen Lu

Pre-training on large-scale unlabeled datasets contribute to the model achieving powerful performance on 3D vision tasks, especially when annotations are limited. However, existing rendering-based self-supervised frameworks are…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Hao Liu , Minglin Chen , Yanni Ma , Haihong Xiao , Ying He

3D point cloud semantic segmentation is a challenging topic in the computer vision field. Most of the existing methods in literature require a large amount of fully labeled training data, but it is extremely time-consuming to obtain these…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Shuang Deng , Qiulei Dong , Bo Liu , Zhanyi Hu

In the field of 3D scene understanding, 3D scene graphs have emerged as a new scene representation that combines geometric and semantic information about objects and their relationships. However, learning semantic 3D scene graphs in a fully…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Sebastian Koch , Pedro Hermosilla , Narunas Vaskevicius , Mirco Colosi , Timo Ropinski

Self-supervised learning of point cloud aims to leverage unlabeled 3D data to learn meaningful representations without reliance on manual annotations. However, current approaches face challenges such as limited data diversity and inadequate…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Keyi Liu , Yeqi Luo , Weidong Yang , Jingyi Xu , Zhijun Li , Wen-Ming Chen , Ben Fei

It is a long-term vision for Autonomous Driving (AD) community that the perception models can learn from a large-scale point cloud dataset, to obtain unified representations that can achieve promising results on different tasks or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jiakang Yuan , Bo Zhang , Xiangchao Yan , Tao Chen , Botian Shi , Yikang Li , Yu Qiao

We present a comprehensive survey and benchmark of both traditional and learning-based methods for surface reconstruction from point clouds. This task is particularly challenging for real-world acquisitions due to factors such as noise,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Raphael Sulzer , Renaud Marlet , Bruno Vallet , Loic Landrieu

Recently, the self-supervised learning framework data2vec has shown inspiring performance for various modalities using a masked student-teacher approach. However, it remains open whether such a framework generalizes to the unique challenges…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Karim Knaebel , Jonas Schult , Alexander Hermans , Bastian Leibe

The difficulties in both data acquisition and annotation substantially restrict the sample sizes of training datasets for 3D medical imaging applications. As a result, constructing high-performance 3D convolutional neural networks from…

Image and Video Processing · Electrical Eng. & Systems 2022-01-06 Shu Zhang , Zihao Li , Hong-Yu Zhou , Jiechao Ma , Yizhou Yu

Though a number of point cloud learning methods have been proposed to handle unordered points, most of them are supervised and require labels for training. By contrast, unsupervised learning of point cloud data has received much less…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Jincen Jiang , Xuequan Lu , Wanli Ouyang , Meili Wang

In recent years, point cloud representation has become one of the research hotspots in the field of computer vision, and has been widely used in many fields, such as autonomous driving, virtual reality, robotics, etc. Although deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Huang Zhang , Changshuo Wang , Shengwei Tian , Baoli Lu , Liping Zhang , Xin Ning , Xiao Bai

The task of point cloud upsampling aims to acquire dense and uniform point sets from sparse and irregular point sets. Although significant progress has been made with deep learning models, state-of-the-art methods require ground-truth dense…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Xinhai Liu , Xinchen Liu , Yu-Shen Liu , Zhizhong Han

In this work, we propose to learn local descriptors for point clouds in a self-supervised manner. In each iteration of the training, the input of the network is merely one unlabeled point cloud. On top of our previous work, that directly…

Robotics · Computer Science 2020-03-12 Yijun Yuan , Jiawei Hou , Andreas Nüchter , Sören Schwertfeger

The scale diversity of point cloud data presents significant challenges in developing unified representation learning techniques for 3D vision. Currently, there are few unified 3D models, and no existing pre-training method is equally…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Ziyi Wang , Yanran Zhang , Jie Zhou , Jiwen Lu

Recently, multi-modal masked autoencoders (MAE) has been introduced in 3D self-supervised learning, offering enhanced feature learning by leveraging both 2D and 3D data to capture richer cross-modal representations. However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Zhimin Chen , Xuewei Chen , Xiao Guo , Yingwei Li , Longlong Jing , Liang Yang , Bing Li

Change detection from traditional \added{2D} optical images has limited capability to model the changes in the height or shape of objects. Change detection using 3D point cloud \added{from photogrammetry or LiDAR surveying} can fill this…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Iris de Gélis , Sudipan Saha , Muhammad Shahzad , Thomas Corpetti , Sébastien Lefèvre , Xiao Xiang Zhu

Self-supervised methods have been proven effective for learning deep representations of 3D point cloud data. Although recent methods in this domain often rely on random masking of inputs, the results of this approach can be improved. We…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Michał Szachniewicz , Wojciech Kozłowski , Michał Stypułkowski , Maciej Zięba

Manual annotation of large-scale point cloud dataset for varying tasks such as 3D object classification, segmentation and detection is often laborious owing to the irregular structure of point clouds. Self-supervised learning, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Mohamed Afham , Isuru Dissanayake , Dinithi Dissanayake , Amaya Dharmasiri , Kanchana Thilakarathna , Ranga Rodrigo

Point clouds, as a primary representation of 3D data, can be categorized into scene domain point clouds and object domain point clouds. Point cloud self-supervised learning (SSL) has become a mainstream paradigm for learning 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Yaohua Zha , Tao Dai , Hang Guo , Yanzi Wang , Bin Chen , Ke Chen , Shu-Tao Xia

Deep neural networks have established themselves as the state-of-the-art methodology in almost all computer vision tasks to date. But their application to processing data lying on non-Euclidean domains is still a very active area of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Chaitanya Kaul , Nick Pears , Suresh Manandhar