English
Related papers

Related papers: Transformers in 3D Point Clouds: A Survey

200 papers

Unlike images which are represented in regular dense grids, 3D point clouds are irregular and unordered, hence applying convolution on them can be difficult. In this paper, we extend the dynamic filter to a new convolution operation, named…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Wenxuan Wu , Zhongang Qi , Li Fuxin

Transformers exhibit great advantages in handling computer vision tasks. They model image classification tasks by utilizing a multi-head attention mechanism to process a series of patches consisting of split images. However, for complex…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Haichao Zhang , Kuangrong Hao , Witold Pedrycz , Lei Gao , Xuesong Tang , Bing Wei

Multi-view projection methods have demonstrated promising performance on 3D understanding tasks like 3D classification and segmentation. However, it remains unclear how to combine such multi-view methods with the widely available 3D point…

Computer Vision and Pattern Recognition · Computer Science 2023-01-26 Abdullah Hamdi , Silvio Giancola , Bernard Ghanem

Along with increasingly popular virtual reality applications, the three-dimensional (3D) point cloud has become a fundamental data structure to characterize 3D objects and surroundings. To process 3D point clouds efficiently, a suitable…

Signal Processing · Electrical Eng. & Systems 2020-12-29 Songyang Zhang , Shuguang Cui , Zhi Ding

Classification and segmentation of 3D point clouds are important tasks in computer vision. Because of the irregular nature of point clouds, most of the existing methods convert point clouds into regular 3D voxel grids before they are used…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Wei Zeng , Theo Gevers

Transformer is a deep neural network that employs a self-attention mechanism to comprehend the contextual relationships within sequential data. Unlike conventional neural networks or updated versions of Recurrent Neural Networks (RNNs) such…

Machine Learning · Computer Science 2023-06-14 Saidul Islam , Hanae Elmekki , Ahmed Elsebai , Jamal Bentahar , Najat Drawel , Gaith Rjoub , Witold Pedrycz

The unprecedented advancements in Large Language Models (LLMs) have shown a profound impact on natural language processing but are yet to fully embrace the realm of 3D understanding. This paper introduces PointLLM, a preliminary effort to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Runsen Xu , Xiaolong Wang , Tai Wang , Yilun Chen , Jiangmiao Pang , Dahua Lin

We present a simple and general framework for feature learning from point clouds. The key to the success of CNNs is the convolution operator that is capable of leveraging spatially-local correlation in data represented densely in grids…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Yangyan Li , Rui Bu , Mingchao Sun , Wei Wu , Xinhan Di , Baoquan Chen

To apply transformer-based models to point cloud understanding, many previous works modify the architecture of transformers by using, e.g., local attention and down-sampling. Although they have achieved promising results, earlier works on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Lanxiao Li , Michael Heizmann

Point cloud is a principal data structure adopted for 3D geometric information encoding. Unlike other conventional visual data, such as images and videos, these irregular points describe the complex shape features of 3D objects, which makes…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Chaoyi Zhang , Yang Song , Lina Yao , Weidong Cai

Explaining decisions made by deep neural networks is a rapidly advancing research topic. In recent years, several approaches have attempted to provide visual explanations of decisions made by neural networks designed for structured 2D image…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Jawad Tayyub , Muhammad Sarmad , Nicolas Schönborn

Graph Neural Networks (GNNs) have gained momentum in graph representation learning and boosted the state of the art in a variety of areas, such as data mining (\emph{e.g.,} social network analysis and recommender systems), computer vision…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Chaoqi Chen , Yushuang Wu , Qiyuan Dai , Hong-Yu Zhou , Mutian Xu , Sibei Yang , Xiaoguang Han , Yizhou Yu

Transformer, a model comprising attention-based encoder-decoder architecture, have gained prevalence in the field of natural language processing (NLP) and recently influenced the computer vision (CV) space. The similarities between computer…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Emerald U. Henry , Onyeka Emebob , Conrad Asotie Omonhinmin

We propose a novel approach to self-supervised learning of point cloud representations by differentiable neural rendering. Motivated by the fact that informative point cloud features should be able to encode rich geometry and appearance…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Di Huang , Sida Peng , Tong He , Honghui Yang , Xiaowei Zhou , Wanli Ouyang

Point clouds data, as one kind of representation of 3D objects, are the most primitive output obtained by 3D sensors. Unlike 2D images, point clouds are disordered and unstructured. Hence it is not straightforward to apply classification…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Zhuyang Xie , Junzhou Chen , Bo Peng

Implicit neural networks have emerged as a crucial technology in 3D surface reconstruction. To reconstruct continuous surfaces from discrete point clouds, encoding the input points into regular grid features (plane or volume) has been…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Shengtao Li , Ge Gao , Yudong Liu , Yu-Shen Liu , Ming Gu

Point cloud data have been widely explored due to its superior accuracy and robustness under various adverse situations. Meanwhile, deep neural networks (DNNs) have achieved very impressive success in various applications such as…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Aoran Xiao , Jiaxing Huang , Dayan Guan , Xiaoqin Zhang , Shijian Lu , Ling Shao

Convolutional Neural Networks (CNNs) have emerged as a powerful strategy for most object detection tasks on 2D images. However, their power has not been fully realised for detecting 3D objects in point clouds directly without converting…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Mingtao Feng , Syed Zulqarnain Gilani , Yaonan Wang , Liang Zhang , Ajmal Mian

Point clouds have become an increasingly important representation for 3D medical imaging, offering a compact, surface-preserving alternative to traditional voxel or mesh-based approaches. Recent advances in deep learning have enabled rapid…

Image and Video Processing · Electrical Eng. & Systems 2026-02-04 Tongxu Zhang , Zhiming Liang , Bei Wang

Transformers have been seldom employed in point cloud roof plane instance segmentation, which is the focus of this study, and existing superpoint Transformers suffer from limited performance due to the use of low-quality superpoints. To…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Cheng Zeng , Xiatian Qi , Chi Chen , Kai Sun , Wangle Zhang , Yuxuan Liu , Yan Meng , Bisheng Yang