English
Related papers

Related papers: On Learning the Right Attention Point for Feature …

200 papers

Estimation of differential geometric quantities in discrete 3D data representations is one of the crucial steps in the geometry processing pipeline. Specifically, estimating normals and sharp feature lines from raw point cloud helps improve…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Albert Matveev , Alexey Artemov , Denis Zorin , Evgeny Burnaev

Attention mechanism has been regarded as an advanced technique to capture long-range feature interactions and to boost the representation capability for convolutional neural networks. However, we found two ignored problems in current…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Zhu Baozhou , Peter Hofstee , Jinho Lee , Zaid Al-Ars

Point clouds provide a flexible and natural representation usable in countless applications such as robotics or self-driving cars. Recently, deep neural networks operating on raw point cloud data have shown promising results on supervised…

Machine Learning · Computer Science 2019-06-04 Jonathan Sauder , Bjarne Sievers

The increased availability of massive point clouds coupled with their utility in a wide variety of applications such as robotics, shape synthesis, and self-driving cars has attracted increased attention from both industry and academia.…

Machine Learning · Computer Science 2020-09-30 Charu Sharma , Manohar Kaul

In contrast to the literature where local patterns in 3D point clouds are captured by customized convolutional operators, in this paper we study the problem of how to effectively and efficiently project such point clouds into a 2D image…

Computer Vision and Pattern Recognition · Computer Science 2020-10-09 Yecheng Lyu , Xinming Huang , Ziming Zhang

In-context learning with attention enables large neural networks to make context-specific predictions by selectively focusing on relevant examples. Here, we adapt this idea to supervised learning procedures such as lasso regression and…

Machine Learning · Statistics 2025-12-11 Erin Craig , Robert Tibshirani

Attention layers -- which map a sequence of inputs to a sequence of outputs -- are core building blocks of the Transformer architecture which has achieved significant breakthroughs in modern artificial intelligence. This paper presents a…

Machine Learning · Computer Science 2023-07-24 Hengyu Fu , Tianyu Guo , Yu Bai , Song Mei

We show how to augment any convolutional network with an attention-based global map to achieve non-local reasoning. We replace the final average pooling by an attention-based aggregation layer akin to a single transformer block, that…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Hugo Touvron , Matthieu Cord , Alaaeldin El-Nouby , Piotr Bojanowski , Armand Joulin , Gabriel Synnaeve , Hervé Jégou

Point clouds have grown in importance in the way computers perceive the world. From LIDAR sensors in autonomous cars and drones to the time of flight and stereo vision systems in our phones, point clouds are everywhere. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Vinit Sarode , Animesh Dhagat , Rangaprasad Arun Srivatsan , Nicolas Zevallos , Simon Lucey , Howie Choset

In 3D point cloud understanding, the core challenge lies in accurately capturing discriminative features within complex neighborhoods, which directly affects the execution precision of downstream tasks such as embodied AI and autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Jiaqi Shi , Jin Xiao , Xiaoguang Hu , Wenxuan Ji , Zichong Jia , Zifan Long , Tianyou Chen , Baochang Zhang

3D point clouds have attracted increasing attention in architecture, engineering, and construction due to their high-quality object representation and efficient acquisition methods. Consequently, many point cloud feature detection methods…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Alberto Tamajo , Bastian Plaß , Thomas Klauer

In recent years, there have been significant advancements in applying attention mechanisms to point cloud analysis. However, attention module variants featured in various research papers often operate under diverse settings and tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Chengzhi Wu , Kaige Wang , Zeyun Zhong , Hao Fu , Junwei Zheng , Jiaming Zhang , Julius Pfrommer , Jürgen Beyerer

We propose a novel technique to incorporate attention within convolutional neural networks using feature maps generated by a separate convolutional autoencoder. Our attention architecture is well suited for incorporation with deep…

Computer Vision and Pattern Recognition · Computer Science 2019-02-11 Chaitanya Kaul , Suresh Manandhar , Nick Pears

The recent advances in 3D sensing technology have made possible the capture of point clouds in significantly high resolution. However, increased detail usually comes at the expense of high storage, as well as computational costs in terms of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Rolandos Alexandros Potamias , Giorgos Bouritsas , Stefanos Zafeiriou

Geometry and topology constitute complementary descriptors of three-dimensional shape, yet existing benchmark datasets primarily capture geometric information while neglecting topological structure. This work addresses this limitation by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Prachi Kudeshia , Jiju Poovvancheri

This paper proposes an innovative approach to Hierarchical Edge Aware 3D Point Cloud Learning (HEA-Net) that seeks to address the challenges of noise in point cloud data, and improve object recognition and segmentation by focusing on edge…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Lei Li

Transformer plays an increasingly important role in various computer vision areas and remarkable achievements have also been made in point cloud analysis. Since they mainly focus on point-wise transformer, an adaptive channel encoding…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Guoquan Xu , Hezhi Cao , Yifan Zhang , Yanxin Ma , Jianwei Wan , Ke Xu

3D point cloud interpretation is a challenging task due to the randomness and sparsity of the component points. Many of the recently proposed methods like PointNet and PointCNN have been focusing on learning shape descriptions from point…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Zhaoyu Su , Pin Siang Tan , Junkang Chow , Jimmy Wu , Yehur Cheong , Yu-Hsing Wang

Point cloud segmentation, which helps us understand the environment of specific structures and objects, can be performed in class-specific and class-agnostic ways. We propose a novel region-based transformer model called Region-Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Dipesh Gyawali , Jian Zhang , BB Karki

In recent years, point cloud upsampling has been widely applied in tasks such as 3D reconstruction and object recognition. This study proposed a novel framework, ReLPU, which enhances upsampling performance by explicitly learning from both…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Tongxu Zhang , Bei Wang