English
Related papers

Related papers: Transformers in 3D Point Clouds: A Survey

200 papers

Deep learning with 3D data such as reconstructed point clouds and CAD models has received great research interests recently. However, the capability of using point clouds with convolutional neural network has been so far not fully explored.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Binh-Son Hua , Minh-Khoi Tran , Sai-Kit Yeung

While Transformers have achieved impressive success in natural language processing and computer vision, their performance on 3D point clouds is relatively poor. This is mainly due to the limitation of Transformers: a demanding need for…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Guocheng Qian , Abdullah Hamdi , Xingdi Zhang , Bernard Ghanem

3D point clouds deep learning is a promising field of research that allows a neural network to learn features of point clouds directly, making it a robust tool for solving 3D scene understanding tasks. While recent works show that point…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Zhiyuan Zhang , Binh-Son Hua , Sai-Kit Yeung

Methods for processing point cloud information have seen a great success in collider physics applications. One recent breakthrough in machine learning is the usage of Transformer networks to learn semantic relationships between sequences in…

Data Analysis, Statistics and Probability · Physics 2021-07-19 Vinicius Mikuni , Florencia Canelli

The remarkable performance of the Transformer architecture in natural language processing has recently also triggered broad interest in Computer Vision. Among other merits, Transformers are witnessed as capable of learning long-range…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Reza Azad , Amirhossein Kazerouni , Moein Heidari , Ehsan Khodapanah Aghdam , Amirali Molaei , Yiwei Jia , Abin Jose , Rijo Roy , Dorit Merhof

Existing networks directly learn feature representations on 3D point clouds for shape analysis. We argue that 3D point clouds are highly redundant and hold irregular (permutation-invariant) structure, which makes it difficult to achieve…

Machine Learning · Computer Science 2020-07-21 Sameera Ramasinghe , Salman Khan , Nick Barnes , Stephen Gould

General point clouds have been increasingly investigated for different tasks, and recently Transformer-based networks are proposed for point cloud analysis. However, there are barely related works for medical point clouds, which are…

Image and Video Processing · Electrical Eng. & Systems 2021-12-20 Jianhui Yu , Chaoyi Zhang , Heng Wang , Dingxin Zhang , Yang Song , Tiange Xiang , Dongnan Liu , Weidong Cai

We present CpT: Convolutional point Transformer - a novel deep learning architecture for dealing with the unstructured nature of 3D point cloud data. CpT is an improvement over existing attention-based Convolutions Neural Networks as well…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Chaitanya Kaul , Joshua Mitton , Hang Dai , Roderick Murray-Smith

The introduction of Transformers architecture has brought about significant breakthroughs in Deep Learning (DL), particularly within Natural Language Processing (NLP). Since their inception, Transformers have outperformed many traditional…

Robotics · Computer Science 2024-12-17 Nikunj Sanghai , Nik Bear Brown

Point cloud is point sets defined in 3D metric space. Point cloud has become one of the most significant data format for 3D representation. Its gaining increased popularity as a result of increased availability of acquisition devices, such…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Saifullahi Aminu Bello , Shangshu Yu , Cheng Wang

Point cloud is an important type of geometric data structure. Due to its irregular format, most researchers transform such data to regular 3D voxel grids or collections of images. This, however, renders data unnecessarily voluminous and…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Charles R. Qi , Hao Su , Kaichun Mo , Leonidas J. Guibas

Recently, there has been a significant interest in performing convolution over irregularly sampled point clouds. Since point clouds are very different from regular raster images, it is imperative to study the generalization of the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-01 Xingyi Li , Wenxuan Wu , Xiaoli Z. Fern , Li Fuxin

Following unprecedented success on the natural language tasks, Transformers have been successfully applied to several computer vision problems, achieving state-of-the-art results and prompting researchers to reconsider the supremacy of…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Fahad Shamshad , Salman Khan , Syed Waqas Zamir , Muhammad Haris Khan , Munawar Hayat , Fahad Shahbaz Khan , Huazhu Fu

Transformers have had a significant impact on natural language processing and have recently demonstrated their potential in computer vision. They have shown promising results over convolution neural networks in fundamental computer vision…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Rojina Kashefi , Leili Barekatain , Mohammad Sabokrou , Fatemeh Aghaeipoor

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev

Learning 3D point sets with rotational invariance is an important and challenging problem in machine learning. Through rotational invariant architectures, 3D point cloud neural networks are relieved from requiring a canonical global pose…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Hedi Zisling , Andrei Sharf

Point cloud analysis has a wide range of applications in many areas such as computer vision, robotic manipulation, and autonomous driving. While deep learning has achieved remarkable success on image-based tasks, there are many unique…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Sushmita Sarker , Prithul Sarker , Gunner Stone , Ryan Gorman , Alireza Tavakkoli , George Bebis , Javad Sattarvand

Point cloud completion is a generation and estimation issue derived from the partial point clouds, which plays a vital role in the applications in 3D computer vision. The progress of deep learning (DL) has impressively improved the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Ben Fei , Weidong Yang , Wenming Chen , Zhijun Li , Yikang Li , Tao Ma , Xing Hu , Lipeng Ma

Recent progresses in 3D deep learning has shown that it is possible to design special convolution operators to consume point cloud data. However, a typical drawback is that rotation invariance is often not guaranteed, resulting in networks…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Zhiyuan Zhang , Binh-Son Hua , David W. Rosen , Sai-Kit Yeung

In the field of autonomous driving and robotics, point clouds are showing their excellent real-time performance as raw data from most of the mainstream 3D sensors. Therefore, point cloud neural networks have become a popular research…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Hanxiao Tan