English
Related papers

Related papers: Self-Supervised Pretraining of 3D Features on any …

200 papers

While multi-class 3D detectors are needed in many robotics applications, training them with fully labeled datasets can be expensive in labeling cost. An alternative approach is to have targeted single-class labels on disjoint data samples.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Mao Ye , Chenxi Liu , Maoqing Yao , Weiyue Wang , Zhaoqi Leng , Charles R. Qi , Dragomir Anguelov

In many critical computer vision scenarios unlabeled data is plentiful, but labels are scarce and difficult to obtain. As a result, semi-supervised learning which leverages unlabeled data to boost the performance of supervised classifiers…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Jay C. Rothenberger , Dimitrios I. Diochnos

Pre-training a model and then fine-tuning it on downstream tasks has demonstrated significant success in the 2D image and NLP domains. However, due to the unordered and non-uniform density characteristics of point clouds, it is non-trivial…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Xiao Zheng , Xiaoshui Huang , Guofeng Mei , Yuenan Hou , Zhaoyang Lyu , Bo Dai , Wanli Ouyang , Yongshun Gong

While current 3D object recognition research mostly focuses on the real-time, onboard scenario, there are many offboard use cases of perception that are largely under-explored, such as using machines to automatically generate high-quality…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Charles R. Qi , Yin Zhou , Mahyar Najibi , Pei Sun , Khoa Vo , Boyang Deng , Dragomir Anguelov

Language model pre-training has proven to be useful in many language understanding tasks. In this paper, we investigate whether it is still helpful to add the self-training method in the pre-training step and the fine-tuning step. Towards…

Computation and Language · Computer Science 2023-02-17 Tong Guo

The performance of existing point cloud-based 3D object detection methods heavily relies on large-scale high-quality 3D annotations. However, such annotations are often tedious and expensive to collect. Semi-supervised learning is a good…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Na Zhao , Tat-Seng Chua , Gim Hee Lee

This paper tries to address a fundamental question in point cloud self-supervised learning: what is a good signal we should leverage to learn features from point clouds without annotations? To answer that, we introduce a point cloud…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Xiaoyu Tian , Haoxi Ran , Yue Wang , Hang Zhao

Large-scale pre-training holds the promise to advance 3D medical object detection, a crucial component of accurate computer-aided diagnosis. Yet, it remains underexplored compared to segmentation, where pre-training has already demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-09-22 Katharina Eckstein , Constantin Ulrich , Michael Baumgartner , Jessica Kächele , Dimitrios Bounias , Tassilo Wald , Ralf Floca , Klaus H. Maier-Hein

3D LiDAR scanners are playing an increasingly important role in autonomous driving as they can generate depth information of the environment. However, creating large 3D LiDAR point cloud datasets with point-level labels requires a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Xiangyu Yue , Bichen Wu , Sanjit A. Seshia , Kurt Keutzer , Alberto L. Sangiovanni-Vincentelli

Understanding 3D point cloud models for learning purposes has become an imperative challenge for real-world identification such as autonomous driving systems. A wide variety of solutions using deep learning have been proposed for point…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Farid Ghareh Mohammadi , Cheng Chen , Farzan Shenavarmasouleh , M. Hadi Amini , Beshoy Morkos , Hamid R. Arabnia

Despite their irresistible success, deep learning algorithms still heavily rely on annotated data. On the other hand, unsupervised settings pose many challenges, especially about determining the right inductive bias in diverse scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Beril Besbinar , Pascal Frossard

It is challenging to train a robust object detector under the supervised learning setting when the annotated data are scarce. Thus, previous approaches tackling this problem are in two categories: semi-supervised learning models that…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Guanghan Ning , Guang Chen , Chaowei Tan , Si Luo , Liefeng Bo , Heng Huang

Methods tackling multi-object tracking need to estimate the number of targets in the sensing area as well as to estimate their continuous state. While the majority of existing methods focus on data association, precise state (3D pose)…

Computer Vision and Pattern Recognition · Computer Science 2019-10-11 Johannes Groß , Aljosa Osep , Bastian Leibe

3D object detection has become indispensable in the field of autonomous driving. To date, gratifying breakthroughs have been recorded in 3D object detection research, attributed to deep learning. However, deep learning algorithms are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yucheng Zhang , Masaki Fukuda , Yasunori Ishii , Kyoko Ohshima , Takayoshi Yamashita

Point clouds provide intrinsic geometric information and surface context for scene understanding. Existing methods for point cloud segmentation require a large amount of fully labeled data. Using advanced depth sensors, collection of large…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Jiacheng Wei , Guosheng Lin , Kim-Hui Yap , Tzu-Yi Hung , Lihua Xie

Object discovery is a core task in computer vision. While fast progresses have been made in supervised object detection, its unsupervised counterpart remains largely unexplored. With the growth of data volume, the expensive cost of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yuqi Wang , Yuntao Chen , Zhaoxiang Zhang

Masked autoencoding has become a successful pretraining paradigm for Transformer models for text, images, and, recently, point clouds. Raw automotive datasets are suitable candidates for self-supervised pre-training as they generally are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Georg Hess , Johan Jaxing , Elias Svensson , David Hagerman , Christoffer Petersson , Lennart Svensson

Self-supervised methods have achieved remarkable success in transfer learning, often achieving the same or better accuracy than supervised pre-training. Most prior work has done so by increasing pre-training computation by adding complex…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Skanda Koppula , Yazhe Li , Evan Shelhamer , Andrew Jaegle , Nikhil Parthasarathy , Relja Arandjelovic , João Carreira , Olivier Hénaff

Annotating large-scale point clouds is highly time-consuming and often infeasible for many complex real-world tasks. Point cloud pre-training has therefore become a promising strategy for learning discriminative representations without…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Guofeng Mei , Xiaoshui Huang , Juan Liu , Jian Zhang , Qiang Wu

The past few years have witnessed the great success and prevalence of self-supervised representation learning within the language and 2D vision communities. However, such advancements have not been fully migrated to the field of 3D point…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Qijian Zhang , Junhui Hou