English
Related papers

Related papers: CloudAttention: Efficient Multi-Scale Attention Sc…

200 papers

LiDAR-generated point clouds are crucial for perceiving outdoor environments. The segmentation of point clouds is also essential for many applications. Previous research has focused on using self-attention and convolution (local attention)…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Abhishek Kuriyal , Vaibhav Kumar , Bharat Lohani

Scene flow depicts the dynamics of a 3D scene, which is critical for various applications such as autonomous driving, robot navigation, AR/VR, etc. Conventionally, scene flow is estimated from dense/regular RGB video frames. With the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Haiyan Wang , Jiahao Pang , Muhammad A. Lodhi , Yingli Tian , Dong Tian

Inference with Transformer-based Large Language Models (LLMs) on long sequences is both costly and slow due to the quadratic complexity of the self-attention mechanism. We introduce Star Attention, a two-phase block-sparse approximation…

Computation and Language · Computer Science 2025-06-02 Shantanu Acharya , Fei Jia , Boris Ginsburg

We propose a fast and accurate surface reconstruction algorithm for unorganized point clouds using an implicit representation. Recent learning methods are either single-object representations with small neural models that allow for high…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Siddhant Ranade , Gonçalo Dias Pais , Ross Tyler Whitaker , Jacinto C. Nascimento , Pedro Miraldo , Srikumar Ramalingam

Instance segmentation is an important task for scene understanding. Compared to the fully-developed 2D, 3D instance segmentation for point clouds have much room to improve. In this paper, we present PointGroup, a new end-to-end bottom-up…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Li Jiang , Hengshuang Zhao , Shaoshuai Shi , Shu Liu , Chi-Wing Fu , Jiaya Jia

Transformer architectures deliver state-of-the-art accuracy via dense full-attention, but their quadratic time and memory complexity with respect to sequence length limits practical deployment. Linear attention mechanisms offer linear or…

Machine Learning · Computer Science 2026-01-21 Xiaojie Xia , Huigang Zhang , Chaoliang Zhong , Jun Sun , Yusuke Oishi

We present a new versatile building block for deep point cloud processing architectures that is equally suited for diverse tasks. This building block combines the ideas of spatial transformers and multi-view convolutional networks with the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Kirill Mazur , Victor Lempitsky

Attention is a core component of transformer architecture, whether encoder-only, decoder-only, or encoder-decoder model. However, the standard softmax attention often produces noisy probability distribution, which can impair effective…

Computation and Language · Computer Science 2025-11-11 Dhananjay Ram , Wei Xia , Stefano Soatto

The paper presents a simple and effective learning-based method for computing a discriminative 3D point cloud descriptor for place recognition purposes. Recent state-of-the-art methods have relatively complex architectures such as…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Jacek Komorowski

Recently Transformer-based models have advanced point cloud understanding by leveraging self-attention mechanisms, however, these methods often overlook latent information in less prominent regions, leading to increased sensitivity to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Yi Wang , Jiaze Wang , Ziyu Guo , Renrui Zhang , Donghao Zhou , Guangyong Chen , Anfeng Liu , Pheng-Ann Heng

In the field of medical CT image processing, convolutional neural networks (CNNs) have been the dominant technique.Encoder-decoder CNNs utilise locality for efficiency, but they cannot simulate distant pixel interactions properly.Recent…

Image and Video Processing · Electrical Eng. & Systems 2022-11-03 Hongyang He , Feng Ziliang , Yuanhang Zheng , Shudong Huang , HaoBing Gao

Transformer-based architectures have demonstrated remarkable success across various domains, but their deployment on edge devices remains challenging due to high memory and computational demands. In this paper, we introduce a novel Reuse…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Seul-Ki Yeom , Tae-Ho Kim

Although the application of Transformers in 3D point cloud processing has achieved significant progress and success, it is still challenging for existing 3D Transformer methods to efficiently and accurately learn both valuable global…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Dening Lu , Kyle Gao , Qian Xie , Linlin Xu , Jonathan Li

We introduce a novel superpoint-based transformer architecture for efficient semantic segmentation of large-scale 3D scenes. Our method incorporates a fast algorithm to partition point clouds into a hierarchical superpoint structure, which…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Damien Robert , Hugo Raguet , Loic Landrieu

Deep learning-based feature matching has shown great superiority for point cloud registration in the absence of pose priors. Although coarse-to-fine matching approaches are prevalent, the coarse matching of existing methods is typically…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Renlang Huang , Yufan Tang , Jiming Chen , Liang Li

Segmentation of plant point clouds to obtain high-precise morphological traits is essential for plant phenotyping. Although the fast development of deep learning has boosted much research on segmentation of plant point clouds, previous…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Ruiming Du , Zhihong Ma , Pengyao Xie , Yong He , Haiyan Cen

Due to the few annotated labels of 3D point clouds, how to learn discriminative features of point clouds to segment object instances is a challenging problem. In this paper, we propose a simple yet effective 3D instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Linghua Tang , Le Hui , Jin Xie

The demand for accurate food quantification has increased in the recent years, driven by the needs of applications in dietary monitoring. At the same time, computer vision approaches have exhibited great potential in automating tasks within…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Valasia Vlachopoulou , Ioannis Sarafis , Alexandros Papadopoulos

Outdoor LiDAR point clouds are typically large-scale and complexly distributed. To achieve efficient and accurate registration, emphasizing the similarity among local regions and prioritizing global local-to-local matching is of utmost…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Weiyi Xue , Fan Lu , Guang Chen

3D instance segmentation aims to predict a set of object instances in a scene, representing them as binary foreground masks with corresponding semantic labels. Currently, transformer-based methods are gaining increasing attention due to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Jiahao Lu , Jiacheng Deng