English
Related papers

Related papers: Global Hierarchical Attention for 3D Point Cloud A…

200 papers

Although accurate and fast point cloud classification is a fundamental task in 3D applications, it is difficult to achieve this purpose due to the irregularity and disorder of point clouds that make it challenging to achieve effective and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Dening Lu , Qian Xie , Linlin Xu , Jonathan Li

A variety of attention mechanisms have been studied to improve the performance of various computer vision tasks. However, the prior methods overlooked the significance of retaining the information on both channel and spatial aspects to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Yichao Liu , Zongru Shao , Nico Hoffmann

Deep learning technology has made great progress in multi-view 3D reconstruction tasks. At present, most mainstream solutions establish the mapping between views and shape of an object by assembling the networks of 2D encoder and 3D decoder…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Zhenwei Zhu , Liying Yang , Xuxin Lin , Chaohao Jiang , Ning Li , Lin Yang , Yanyan Liang

We describe an efficient hierarchical method to compute attention in the Transformer architecture. The proposed attention mechanism exploits a matrix structure similar to the Hierarchical Matrix (H-Matrix) developed by the numerical…

Machine Learning · Computer Science 2021-07-27 Zhenhai Zhu , Radu Soricut

The human brain can effortlessly recognize and localize objects, whereas current 3D object detection methods based on LiDAR point clouds still report inferior performance for detecting occluded and distant objects: the point cloud…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Liang Du , Xiaoqing Ye , Xiao Tan , Edward Johns , Bo Chen , Errui Ding , Xiangyang Xue , Jianfeng Feng

We present a simple but effective attention named the unary-pairwise attention (UPA) for modeling the relationship between 3D point clouds. Our idea is motivated by the analysis that the standard self-attention (SA) that operates globally…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Haoyi Xiu , Xin Liu , Weimin Wang , Kyoung-Sook Kim , Takayuki Shinohara , Qiong Chang , Masashi Matsuoka

Data augmentation is widely used to train deep learning models to address data scarcity. However, traditional data augmentation (TDA) typically relies on simple geometric transformation, such as random rotation and rescaling, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Dekai Zhu , Stefan Gavranovic , Flavien Boussuge , Benjamin Busam , Slobodan Ilic

This paper proposes a general solution to enable point cloud recognition models to handle distribution shifts at test time. Unlike prior methods, which rely heavily on training data (often inaccessible during online inference) and are…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hongyu Sun , Qiuhong Ke , Ming Cheng , Yongcai Wang , Deying Li , Chenhui Gou , Jianfei Cai

Domain Adaptation (DA) approaches achieved significant improvements in a wide range of machine learning and computer vision tasks (i.e., classification, detection, and segmentation). However, as far as we are aware, there are few methods…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Can Qin , Haoxuan You , Lichen Wang , C. -C. Jay Kuo , Yun Fu

Robust point cloud registration is a fundamental task in 3D computer vision and geometric deep learning, essential for applications such as large-scale 3D reconstruction, augmented reality, and scene understanding. However, the performance…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Dongxu Zhang , Yingsen Wang , Yiding Sun , Haoran Xu , Peilin Fan , Jihua Zhu

This paper advocates incorporating a Low-Rank Global Attention (LRGA) module, a computation and memory efficient variant of the dot-product attention (Vaswani et al., 2017), to Graph Neural Networks (GNNs) for improving their generalization…

Machine Learning · Computer Science 2020-11-13 Omri Puny , Heli Ben-Hamu , Yaron Lipman

Graph Neural Networks (GNNs) excel at relational reasoning but face two persistent challenges: the lack of interpretable attribution for heterogeneous node types, and the computational overhead of message passing over large, noisy graphs.…

Machine Learning · Computer Science 2026-05-12 Seungwoo Kum

Multi-hop QA (Question Answering) is the task of finding the answer to a question across multiple documents. In recent years, a number of Deep Learning-based approaches have been proposed to tackle this complex task, as well as a few…

Computation and Language · Computer Science 2023-01-30 Yunjie He , Philip John Gorinski , Ieva Staliunaite , Pontus Stenetorp

Point cloud based retrieval for place recognition is an emerging problem in vision field. The main challenge is how to find an efficient way to encode the local features into a discriminative global descriptor. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Wenxiao Zhang , Chunxia Xiao

We propose a novel framework to learn 3D point cloud semantics from 2D multi-view image observations containing pose error. On the one hand, directly learning from the massive, unstructured and unordered 3D point cloud is computationally…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Yuhang He , Lin Chen , Junkun Xie , Long Chen

This paper tackles the high computational/space complexity associated with Multi-Head Self-Attention (MHSA) in vanilla vision transformers. To this end, we propose Hierarchical MHSA (H-MHSA), a novel approach that computes self-attention in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Yun Liu , Yu-Huan Wu , Guolei Sun , Le Zhang , Ajad Chhatkuli , Luc Van Gool

For person re-identification (re-id), attention mechanisms have become attractive as they aim at strengthening discriminative features and suppressing irrelevant ones, which matches well the key of re-id, i.e., discriminative feature…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Zhizheng Zhang , Cuiling Lan , Wenjun Zeng , Xin Jin , Zhibo Chen

We present an innovative two-headed attention layer that combines geometric and latent features to segment a 3D scene into semantically meaningful subsets. Each head combines local and global information, using either the geometric or…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Hanz Cuevas-Velasquez , Antonio Javier Gallego , Robert B. Fisher

Point cloud analysis is the cornerstone of many downstream tasks, among which aggregating local structures is the basis for understanding point cloud data. While numerous works aggregate neighbor using three-dimensional relative…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Jiaqi Shi , Jin Xiao , Xiaoguang Hu , Boyang Song , Hao Jiang , Tianyou Chen , Baochang Zhang

In this paper, we propose a point cloud classification method based on graph neural network and manifold learning. Different from the conventional point cloud analysis methods, this paper uses manifold learning algorithms to embed point…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Dinghao Yang , Wei Gao