English
Related papers

Related papers: Transformers in 3D Point Clouds: A Survey

200 papers

Transformer-based models have significantly advanced natural language processing and computer vision in recent years. However, due to the irregular and disordered structure of point cloud data, transformer-based models for 3D deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Xincheng Yang , Mingze Jin , Weiji He , Qian Chen

Transformer-based models have transformed the landscape of natural language processing (NLP) and are increasingly applied to computer vision tasks with remarkable success. These models, renowned for their ability to capture long-range…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Gracile Astlin Pereira , Muhammad Hussain

Point cloud data now are popular data representations in a number of three-dimensional (3D) vision research realms. However, due to the limited performance of sensors and sensing noise, the raw data usually suffer from sparsity, noise, and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Siwen Quan , Junhao Yu , Ziming Nie , Muze Wang , Sijia Feng , Pei An , Jiaqi Yang

Transformers have achieved great success in many artificial intelligence fields, such as natural language processing, computer vision, and audio processing. Therefore, it is natural to attract lots of interest from academic and industry…

Machine Learning · Computer Science 2021-06-16 Tianyang Lin , Yuxin Wang , Xiangyang Liu , Xipeng Qiu

Vision transformers have become popular as a possible substitute to convolutional neural networks (CNNs) for a variety of computer vision applications. These transformers, with their ability to focus on global relationships in images, offer…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Asifullah Khan , Zunaira Rauf , Anabia Sohail , Abdul Rehman , Hifsa Asif , Aqsa Asif , Umair Farooq

With the rapid advancement of technology, 3D data acquisition and utilization have become increasingly prevalent across various fields, including computer vision, robotics, and geospatial analysis. 3D data, captured through methods such as…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Siming Yan

Point clouds are rich geometric data structures, where their three dimensional structure offers an excellent domain for understanding the representation learning and generative modeling in 3D space. In this work, we aim to improve the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Lingjie Kong , Pankaj Rajak , Siamak Shakeri

LiDAR sensors are an integral part of modern autonomous vehicles as they provide an accurate, high-resolution 3D representation of the vehicle's surroundings. However, it is computationally difficult to make use of the ever-increasing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Marc Uecker , Tobias Fleck , Marcel Pflugfelder , J. Marius Zöllner

Transformer, first applied to the field of natural language processing, is a type of deep neural network mainly based on the self-attention mechanism. Thanks to its strong representation capabilities, researchers are looking at ways to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Kai Han , Yunhe Wang , Hanting Chen , Xinghao Chen , Jianyuan Guo , Zhenhua Liu , Yehui Tang , An Xiao , Chunjing Xu , Yixing Xu , Zhaohui Yang , Yiman Zhang , Dacheng Tao

Three dimensional (3D) object recognition is becoming a key desired capability for many computer vision systems such as autonomous vehicles, service robots and surveillance drones to operate more effectively in unstructured environments.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Chenxi Xiao , Juan Wachs

Transformer, as an alternative to CNN, has been proven effective in many modalities (e.g., texts and images). For 3D point cloud transformers, existing efforts focus primarily on pushing their accuracy to the state-of-the-art level.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Zhijian Liu , Xinyu Yang , Haotian Tang , Shang Yang , Song Han

Transformers have made significant strides across various artificial intelligence domains, including natural language processing, computer vision, and audio processing. This success has naturally garnered considerable interest from both…

Image and Video Processing · Electrical Eng. & Systems 2024-08-12 Elyas Rashno , Amir Eskandari , Aman Anand , Farhana Zulkernine

Point cloud analysis (such as 3D segmentation and detection) is a challenging task, because of not only the irregular geometries of many millions of unordered points, but also the great variations caused by depth, viewpoint, occlusion, etc.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Tuo Feng , Wenguan Wang , Xiaohan Wang , Yi Yang , Qinghua Zheng

Transformer plays an increasingly important role in various computer vision areas and remarkable achievements have also been made in point cloud analysis. Since they mainly focus on point-wise transformer, an adaptive channel encoding…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Guoquan Xu , Hezhi Cao , Yifan Zhang , Yanxin Ma , Jianwei Wan , Ke Xu

Analyzing the geometric and semantic properties of 3D point clouds through the deep networks is still challenging due to the irregularity and sparsity of samplings of their geometric structures. This paper presents a new method to define…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Artem Komarichev , Zichun Zhong , Jing Hua

We propose the use of a Transformer to accurately predict normals from point clouds with noise and density variations. Previous learning-based methods utilize PointNet variants to explicitly extract multi-scale features at different input…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Barry Shichen Hu , Siyun Liang , Johannes Paetzold , Huy H. Nguyen , Isao Echizen , Jiapeng Tang

With the development of 3D sensing technologies, point clouds have attracted increasing attention in a variety of applications for 3D object representation, such as autonomous driving, 3D immersive tele-presence and heritage reconstruction.…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Junkun Qi , Wei Hu , Zongming Guo

As a pioneering work exploring transformer architecture for 3D point cloud understanding, Point Transformer achieves impressive results on multiple highly competitive benchmarks. In this work, we analyze the limitations of the Point…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Xiaoyang Wu , Yixing Lao , Li Jiang , Xihui Liu , Hengshuang Zhao

Point clouds are a very efficient way to represent volumetric data in medical imaging. First, they do not occupy resources for empty spaces and therefore can avoid trade-offs between resolution and field-of-view for voxel-based 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Mattias Paul Heinrich

Recent studies on visual reinforcement learning (visual RL) have explored the use of 3D visual representations. However, none of these work has systematically compared the efficacy of 3D representations with 2D representations across…

Robotics · Computer Science 2023-06-13 Zhan Ling , Yunchao Yao , Xuanlin Li , Hao Su