English
Related papers

Related papers: Point Cloud Pre-training with Diffusion Models

200 papers

We present a probabilistic model for point cloud generation, which is fundamental for various 3D vision tasks such as shape completion, upsampling, synthesis and data augmentation. Inspired by the diffusion process in non-equilibrium…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Shitong Luo , Wei Hu

Pre-trained point cloud models have found extensive applications in 3D understanding tasks like object classification and part segmentation. However, the prevailing strategy of full fine-tuning in downstream tasks leads to large per-task…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Yaohua Zha , Jinpeng Wang , Tao Dai , Bin Chen , Zhi Wang , Shu-Tao Xia

We describe a simple pre-training approach for point clouds. It works in three steps: 1. Mask all points occluded in a camera view; 2. Learn an encoder-decoder model to reconstruct the occluded points; 3. Use the encoder weights as…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Hanchen Wang , Qi Liu , Xiangyu Yue , Joan Lasenby , Matthew J. Kusner

Pre-trained large-scale models have exhibited remarkable efficacy in computer vision, particularly for 2D image analysis. However, when it comes to 3D point clouds, the constrained accessibility of data, in contrast to the vast repositories…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Mengke Li , Da Li , Guoqing Yang , Yiu-ming Cheung , Hui Huang

Recovering high quality surfaces from noisy point clouds, known as point cloud denoising, is a fundamental yet challenging problem in geometry processing. Most of the existing methods either directly denoise the noisy input or filter raw…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Zheng Liu , Yaowu Zhao , Sijing Zhan , Yuanyuan Liu , Renjie Chen , Ying He

Large language models (LLMs) based on the generative pre-training transformer (GPT) have demonstrated remarkable effectiveness across a diverse range of downstream tasks. Inspired by the advancements of the GPT, we present PointGPT, a novel…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Guangyan Chen , Meiling Wang , Yi Yang , Kai Yu , Li Yuan , Yufeng Yue

Recently, great progress has been made in 3D deep learning with the emergence of deep neural networks specifically designed for 3D point clouds. These networks are often trained from scratch or from pre-trained models learned purely from…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Bach Tran , Binh-Son Hua , Anh Tuan Tran , Minh Hoai

Point clouds provide a flexible and natural representation usable in countless applications such as robotics or self-driving cars. Recently, deep neural networks operating on raw point cloud data have shown promising results on supervised…

Machine Learning · Computer Science 2019-06-04 Jonathan Sauder , Bjarne Sievers

Point cloud upsampling focuses on generating a dense, uniform and proximity-to-surface point set. Most previous approaches accomplish these objectives by carefully designing a single-stage network, which makes it still challenging to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Hang Du , Xuejun Yan , Jingjing Wang , Di Xie , Shiliang Pu

Pretraining on large labeled datasets is a prerequisite to achieve good performance in many computer vision tasks like 2D object recognition, video classification etc. However, pretraining is not widely used for 3D recognition tasks where…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Zaiwei Zhang , Rohit Girdhar , Armand Joulin , Ishan Misra

Automatic synthesis of high quality 3D shapes is an ongoing and challenging area of research. While several data-driven methods have been proposed that make use of neural networks to generate 3D shapes, none of them reach the level of…

Computer Vision and Pattern Recognition · Computer Science 2019-06-28 Isaak Lim , Moritz Ibing , Leif Kobbelt

Pre-training is crucial in 3D-related fields such as autonomous driving where point cloud annotation is costly and challenging. Many recent studies on point cloud pre-training, however, have overlooked the issue of incompleteness, where…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Hao Yang , Haiyang Wang , Di Dai , Liwei Wang

The manual annotation for large-scale point clouds costs a lot of time and is usually unavailable in harsh real-world scenarios. Inspired by the great success of the pre-training and fine-tuning paradigm in both vision and language tasks,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Chao Sun , Zhedong Zheng , Xiaohan Wang , Mingliang Xu , Yi Yang

While Transformers have achieved impressive success in natural language processing and computer vision, their performance on 3D point clouds is relatively poor. This is mainly due to the limitation of Transformers: a demanding need for…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Guocheng Qian , Abdullah Hamdi , Xingdi Zhang , Bernard Ghanem

Foundation models for point cloud data have recently grown in capability, often leveraging extensive representation learning from language or vision. In this work, we take a more controlled approach by introducing a lightweight…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Konrad Szafer , Marek Kraft , Dominik Belter

Point cloud data has been extensively studied due to its compact form and flexibility in representing complex 3D structures. The ability of point cloud data to accurately capture and represent intricate 3D geometry makes it an ideal choice…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Ben Fei , Weidong Yang , Liwen Liu , Tianyue Luo , Rui Zhang , Yixuan Li , Ying He

Existing deep learning methods for the reconstruction and denoising of point clouds rely on small datasets of 3D shapes. We circumvent the problem by leveraging deep learning methods trained on billions of images. We propose a method to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Pietro Bonazzi , Marie-Julie Rakatosaona , Marco Cannici , Federico Tombari , Davide Scaramuzza

As the task of 2D-to-3D reconstruction has gained significant attention in various real-world scenarios, it becomes crucial to be able to generate high-quality point clouds. Despite the recent success of deep learning models in generating…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yu Feng , Xing Shi , Mengli Cheng , Yun Xiong

In the domain of point cloud analysis, despite the significant capabilities of Graph Neural Networks (GNNs) in managing complex 3D datasets, existing approaches encounter challenges like high computational costs and scalability issues with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qiang Zheng , Yafei Qi , Chen Wang , Chao Zhang , Jian Sun

Data augmentation is an effective regularization strategy for mitigating overfitting in deep neural networks, and it plays a crucial role in 3D vision tasks, where the point cloud data is relatively limited. While mixing-based augmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Yi Wang , Jiaze Wang , Jinpeng Li , Zixu Zhao , Guangyong Chen , Anfeng Liu , Pheng-Ann Heng