English
Related papers

Related papers: Point Transformer

200 papers

Surface reconstruction from raw point clouds has been studied for decades in the computer graphics community, which is highly demanded by modeling and rendering applications nowadays. Classic solutions, such as Poisson surface…

Graphics · Computer Science 2023-10-11 Hui Tian , Zheng Qin , Renjiao Yi , Chenyang Zhu , Kai Xu

Most approaches for semantic segmentation use only information from color cameras to parse the scenes, yet recent advancements show that using depth data allows to further improve performances. In this work, we focus on transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Francesco Barbato , Giulia Rizzoli , Pietro Zanuttigh

Point cloud analysis has drawn broader attentions due to its increasing demands in various fields. Despite the impressive performance has been achieved on several databases, researchers neglect the fact that the orientation of those point…

Computer Vision and Pattern Recognition · Computer Science 2019-11-07 Xiao Sun , Zhouhui Lian , Jianguo Xiao

Local feature matching between images remains a challenging task, especially in the presence of significant appearance variations, e.g., extreme viewpoint changes. In this work, we propose DeepMatcher, a deep Transformer-based network built…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Tao Xie , Kun Dai , Ke Wang , Ruifeng Li , Lijun Zhao

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev

Transformers have shown superior performance on various computer vision tasks with their capabilities to capture long-range dependencies. Despite the success, it is challenging to directly apply Transformers on point clouds due to their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Jinyoung Park , Sanghyeok Lee , Sihyeon Kim , Yunyang Xiong , Hyunwoo J. Kim

General point clouds have been increasingly investigated for different tasks, and recently Transformer-based networks are proposed for point cloud analysis. However, there are barely related works for medical point clouds, which are…

Image and Video Processing · Electrical Eng. & Systems 2021-12-20 Jianhui Yu , Chaoyi Zhang , Heng Wang , Dingxin Zhang , Yang Song , Tiange Xiang , Dongnan Liu , Weidong Cai

Transformer-based models have significantly advanced natural language processing and computer vision in recent years. However, due to the irregular and disordered structure of point cloud data, transformer-based models for 3D deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Xincheng Yang , Mingze Jin , Weiji He , Qian Chen

The success of deep learning methods led to significant breakthroughs in 3-D point cloud processing tasks with applications in remote sensing. Existing methods utilize convolutions that have some limitations, as they assume a uniform input…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Dimple A Shajahan , Mukund Varma T , Ramanathan Muthuganapathy

Recently, graph-based and Transformer-based deep learning networks have demonstrated excellent performances on various point cloud tasks. Most of the existing graph methods are based on static graph, which take a fixed input to establish…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Wei Zhou , Qian Wang , Weiwei Jin , Xinzhe Shi , Ying He

The point cloud learning community witnesses a modeling shift from CNNs to Transformers, where pure Transformer architectures have achieved top accuracy on the major learning benchmarks. However, existing point Transformers are…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Zhang Cheng , Haocheng Wan , Xinyi Shen , Zizhao Wu

Deep learning with 3D data has progressed significantly since the introduction of convolutional neural networks that can handle point order ambiguity in point cloud data. While being able to achieve good accuracies in various scene…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Zhiyuan Zhang , Binh-Son Hua , Sai-Kit Yeung

While convolutional neural networks have shown a tremendous impact on various computer vision tasks, they generally demonstrate limitations in explicitly modeling long-range dependencies due to the intrinsic locality of the convolution…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Guanglei Yang , Hao Tang , Mingli Ding , Nicu Sebe , Elisa Ricci

Currently, this paper is under review in IEEE. Transformers have intrigued the vision research community with their state-of-the-art performance in natural language processing. With their superior performance, transformers have found their…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Preetam Ghosh , Swalpa Kumar Roy , Bikram Koirala , Behnood Rasti , Paul Scheunders

In Transformer-based neural machine translation (NMT), the positional encoding mechanism helps the self-attention networks to learn the source representation with order dependency, which makes the Transformer-based NMT achieve…

Computation and Language · Computer Science 2020-04-09 Kehai Chen , Rui Wang , Masao Utiyama , Eiichiro Sumita

We present a simple and general framework for feature learning from point clouds. The key to the success of CNNs is the convolution operator that is capable of leveraging spatially-local correlation in data represented densely in grids…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Yangyan Li , Rui Bu , Mingchao Sun , Wei Wu , Xinhan Di , Baoquan Chen

Post-disaster damage assessment requires rapid and accurate semantic segmentation of 3D point clouds to identify critical infrastructure such as damaged buildings and roads. Early Point Transformers (e.g., PTv1, PTv2) relied on…

Machine Learning · Computer Science 2026-05-19 Nhut Le , Ehsan Karimi , Maryam Rahnemoonfar

Recently, there have been some attempts of Transformer in 3D point cloud classification. In order to reduce computations, most existing methods focus on local spatial attention, but ignore their content and fail to establish relationships…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yahui Liu , Bin Tian , Yisheng Lv , Lingxi Li , Feiyue Wang

In this paper we propose a rotation-invariant deep network for point clouds analysis. Point-based deep networks are commonly designed to recognize roughly aligned 3D shapes based on point coordinates, but suffer from performance drops with…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Ruixuan Yu , Xin Wei , Federico Tombari , Jian Sun

Hypergraphs play a pivotal role in the modelling of data featuring higher-order relations involving more than two entities. Hypergraph neural networks emerge as a powerful tool for processing hypergraph-structured data, delivering…

Machine Learning · Computer Science 2024-06-04 Zexi Liu , Bohan Tang , Ziyuan Ye , Xiaowen Dong , Siheng Chen , Yanfeng Wang