English
Related papers

Related papers: Point Transformer V2: Grouped Vector Attention and…

200 papers

The irregularity and permutation invariance of point cloud data pose challenges for effective learning. Conventional methods for addressing this issue involve converting raw point clouds to intermediate representations such as 3D voxel…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Athrva Atul Pandhare

The self-attention mechanism has been a key factor in the advancement of vision Transformers. However, its quadratic complexity imposes a heavy computational burden in high-resolution scenarios, restricting the practical application.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Dongchen Han , Tianyu Li , Ziyi Wang , Gao Huang

3D point cloud is an efficient and flexible representation of 3D structures. Recently, neural networks operating on point clouds have shown superior performance on 3D understanding tasks such as shape classification and part segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Wentao Yuan , David Held , Christoph Mertz , Martial Hebert

We present a novel compression framework for 3D Gaussian splatting (3DGS) data that leverages transform coding tools originally developed for point clouds. Contrary to existing 3DGS compression methods, our approach can produce compressed…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Chenjunjie Wang , Shashank N. Sridhara , Eduardo Pavez , Antonio Ortega , Cheng Chang

Place recognition plays an essential role in the field of autonomous driving and robot navigation. Point cloud based methods mainly focus on extracting global descriptors from local features of point clouds. Despite having achieved…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Tian-Xing Xu , Yuan-Chen Guo , Zhiqiang Li , Ge Yu , Yu-Kun Lai , Song-Hai Zhang

To better address challenging issues of the irregularity and inhomogeneity inherently present in 3D point clouds, researchers have been shifting their focus from the design of hand-craft point feature towards the learning of 3D point…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Xiang Li , Mingyang Wang , Congcong Wen , Lingjing Wang , Nan Zhou , Yi Fang

This work proposes a general-purpose, fully-convolutional network architecture for efficiently processing large-scale 3D data. One striking characteristic of our approach is its ability to process unorganized 3D representations such as…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Dario Rethage , Johanna Wald , Jürgen Sturm , Nassir Navab , Federico Tombari

Transformers have emerged as a powerful neural network architecture capable of tackling a wide range of learning tasks. In this work, we provide a theoretical analysis of their ability to automatically extract structure from data in an…

Machine Learning · Statistics 2025-10-29 Rodrigo Maulen-Soto , Pierre Marion , Claire Boyer

Transformers have become prevalent in computer vision due to their performance and flexibility in modelling complex operations. Of particular significance is the 'cross-attention' operation, which allows a vector representation (e.g. of an…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Ali Athar , Jonathon Luiten , Alexander Hermans , Deva Ramanan , Bastian Leibe

Transformers have recently shown superior performances on various vision tasks. The large, sometimes even global, receptive field endows Transformer models with higher representation power over their CNN counterparts. Nevertheless, simply…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Zhuofan Xia , Xuran Pan , Shiji Song , Li Erran Li , Gao Huang

Despite the progress on 3D point cloud deep learning, most prior works focus on learning features that are invariant to translation and point permutation, and very limited efforts have been devoted for rotation invariant property. Several…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Zhiyuan Zhang , Licheng Yang , Zhiyu Xiang

Point cloud stands as the most widely adopted format for representing 3D shapes and scenes due to its simplicity and geometric fidelity. However, its inherent unordered and irregular nature, exacerbated by sensor noise and occlusions,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Minhas Kamal , Hiranya Garbha Kumar , Balakrishnan Prabhakaran

Point clouds data, as one kind of representation of 3D objects, are the most primitive output obtained by 3D sensors. Unlike 2D images, point clouds are disordered and unstructured. Hence it is not straightforward to apply classification…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Zhuyang Xie , Junzhou Chen , Bo Peng

This paper presents a parameter-efficient prompt tuning method, named PPT, to adapt a large multi-modal model for 3D point cloud understanding. Existing strategies are quite expensive in computation and storage, and depend on time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Hongyu Sun , Yongcai Wang , Wang Chen , Haoran Deng , Deying Li

3D point cloud perception remains tightly coupled to custom CUDA operators for spatial operations, limiting portability and efficiency on non-NVIDIA, AMD, and embedded hardware. We introduce PointTransformerX (PTX), a fully PyTorch-native…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Laurenz Reichardt , Nikolas Ebert , Oliver Wasenmüller

We present a novel attention-based mechanism to learn enhanced point features for point cloud processing tasks, e.g., classification and segmentation. Unlike prior works, which were trained to optimize the weights of a pre-selected set of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Liqiang Lin , Pengdi Huang , Chi-Wing Fu , Kai Xu , Hao Zhang , Hui Huang

Attention-based models such as transformers have shown outstanding performance on dense prediction tasks, such as semantic segmentation, owing to their capability of capturing long-range dependency in an image. However, the benefit of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Ashutosh Agarwal , Chetan Arora

Attention based language models have become a critical component in state-of-the-art natural language processing systems. However, these models have significant computational requirements, due to long training times, dense operations and…

Computation and Language · Computer Science 2021-06-11 Ivan Chelombiev , Daniel Justus , Douglas Orr , Anastasia Dietrich , Frithjof Gressmann , Alexandros Koliousis , Carlo Luschi

Though 3D object detection from point clouds has achieved rapid progress in recent years, the lack of flexible and high-performance proposal refinement remains a great hurdle for existing state-of-the-art two-stage detectors. Previous works…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Hualian Sheng , Sijia Cai , Yuan Liu , Bing Deng , Jianqiang Huang , Xian-Sheng Hua , Min-Jian Zhao

In the domain of point cloud analysis, despite the significant capabilities of Graph Neural Networks (GNNs) in managing complex 3D datasets, existing approaches encounter challenges like high computational costs and scalability issues with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qiang Zheng , Yafei Qi , Chen Wang , Chao Zhang , Jian Sun