English
Related papers

Related papers: Point-BERT: Pre-training 3D Point Cloud Transforme…

200 papers

Point cloud registration is a key task in many computational fields. Previous correspondence matching based methods require the inputs to have distinctive geometric structures to fit a 3D rigid transformation according to point-wise sparse…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Hao Xu , Shuaicheng Liu , Guangfu Wang , Guanghui Liu , Bing Zeng

Point clouds are a fundamental 3D representation in computer vision, enabling a wide range of perception tasks. However, real-world point clouds often suffer from degradations such as incompleteness, noise, outliers, and irregular density,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Haoqing Wu , Alexa Nawotki , Jochen Garcke

BERT adopts masked language modeling (MLM) for pre-training and is one of the most successful pre-training models. Since BERT neglects dependency among predicted tokens, XLNet introduces permuted language modeling (PLM) for pre-training to…

Computation and Language · Computer Science 2020-11-03 Kaitao Song , Xu Tan , Tao Qin , Jianfeng Lu , Tie-Yan Liu

Point clouds have grown in importance in the way computers perceive the world. From LIDAR sensors in autonomous cars and drones to the time of flight and stereo vision systems in our phones, point clouds are everywhere. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Vinit Sarode , Animesh Dhagat , Rangaprasad Arun Srivatsan , Nicolas Zevallos , Simon Lucey , Howie Choset

Recent advancements in Diffusion Transformer (DiT) models have significantly improved 3D point cloud generation. However, existing methods primarily focus on local feature extraction while overlooking global topological information, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Zechao Guan , Feng Yan , Shuai Du , Lin Ma , Qingshan Liu

Point cloud segmentation, which helps us understand the environment of specific structures and objects, can be performed in class-specific and class-agnostic ways. We propose a novel region-based transformer model called Region-Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Dipesh Gyawali , Jian Zhang , BB Karki

Though a number of point cloud learning methods have been proposed to handle unordered points, most of them are supervised and require labels for training. By contrast, unsupervised learning of point cloud data has received much less…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Jincen Jiang , Xuequan Lu , Wanli Ouyang , Meili Wang

As two fundamental representation modalities of 3D objects, 3D point clouds and multi-view 2D images record shape information from different domains of geometric structures and visual appearances. In the current deep learning era,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Qijian Zhang , Junhui Hou , Yue Qian

3D point cloud registration is a fundamental task in robotics and computer vision. Recently, many learning-based point cloud registration methods based on correspondences have emerged. However, these methods heavily rely on such…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Lifa Zhu , Dongrui Liu , Changwei Lin , Rui Yan , Francisco Gómez-Fernández , Ninghua Yang , Ziyong Feng

The ever-increasing 3D application makes the point cloud compression unprecedentedly important and needed. In this paper, we propose a patch-based compression process using deep learning, focusing on the lossy point cloud geometry…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Kang You , Pan Gao

Recently, Transformer-based methods for point cloud learning have achieved good results on various point cloud learning benchmarks. However, since the attention mechanism needs to generate three feature vectors of query, key, and value to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Wei Zhou , Weiwei Jin , Qian Wang , Yifan Wang , Dekui Wang , Xingxing Hao , Yongxiang Yu

3D point cloud analysis has drawn a lot of research attention due to its wide applications. However, collecting massive labelled 3D point cloud data is both time-consuming and labor-intensive. This calls for data-efficient learning methods.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Fayao Liu , Guosheng Lin , Chuan-Sheng Foo , Chaitanya K. Joshi , Jie Lin

Large-scale pre-trained models like BERT, have obtained a great success in various Natural Language Processing (NLP) tasks, while it is still a challenge to adapt them to the math-related tasks. Current pre-trained models neglect the…

Computation and Language · Computer Science 2021-05-04 Shuai Peng , Ke Yuan , Liangcai Gao , Zhi Tang

Predicting the future can significantly improve the safety of intelligent vehicles, which is a key component in autonomous driving. 3D point clouds accurately model 3D information of surrounding environment and are crucial for intelligent…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Fan Lu , Guang Chen , Yinlong Liu , Zhijun Li , Sanqing Qu , Tianpei Zou

Unlike on images, semantic learning on 3D point clouds using a deep network is challenging due to the naturally unordered data structure. Among existing works, PointNet has achieved promising results by directly learning on point sets.…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Yiru Shen , Chen Feng , Yaoqing Yang , Dong Tian

In a point cloud sequence, 3D object tracking aims to predict the location and orientation of an object in the current search point cloud given a template point cloud. Motivated by the success of transformers, we propose Point Tracking…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Changqing Zhou , Zhipeng Luo , Yueru Luo , Tianrui Liu , Liang Pan , Zhongang Cai , Haiyu Zhao , Shijian Lu

We introduce PointConvFormer, a novel building block for point cloud based deep network architectures. Inspired by generalization theory, PointConvFormer combines ideas from point convolution, where filter weights are only based on relative…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Wenxuan Wu , Li Fuxin , Qi Shan

In the field of resource-constrained robots and the need for effective place recognition in multi-robotic systems, this article introduces RecNet, a novel approach that concurrently addresses both challenges. The core of RecNet's…

Robotics · Computer Science 2024-10-04 Nikolaos Stathoulopoulos , Mario A. V. Saucedo , Anton Koval , George Nikolakopoulos

BERT (Bidirectional Encoder Representations from Transformers) and related pre-trained Transformers have provided large gains across many language understanding tasks, achieving a new state-of-the-art (SOTA). BERT is pre-trained on two…

Computation and Language · Computer Science 2020-06-22 Michael Glass , Alfio Gliozzo , Rishav Chakravarti , Anthony Ferritto , Lin Pan , G P Shrivatsa Bhargav , Dinesh Garg , Avirup Sil

Learning and analyzing 3D point clouds with deep networks is challenging due to the sparseness and irregularity of the data. In this paper, we present a data-driven point cloud upsampling technique. The key idea is to learn multi-level…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Lequan Yu , Xianzhi Li , Chi-Wing Fu , Daniel Cohen-Or , Pheng-Ann Heng