English
Related papers

Related papers: Voxel Set Transformer: A Set-to-Set Approach to 3D…

200 papers

In this paper, we present Position-to-Structure Attention Transformers (PS-Former), a Transformer-based algorithm for 3D point cloud recognition. PS-Former deals with the challenge in 3D point cloud representation where points are not…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Zheng Ding , James Hou , Zhuowen Tu

Embodied intelligence requires agents to interact with 3D environments in real time based on language instructions. A foundational task in this domain is ego-centric 3D visual grounding. However, the point clouds rendered from RGB-D images…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Qihang Peng , Henry Zheng , Gao Huang

Inferring 3D locations and shapes of multiple objects from a single 2D image is a long-standing objective of computer vision. Most of the existing works either predict one of these 3D properties or focus on solving both for a single object.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Feng Liu , Xiaoming Liu

Image-only and pseudo-LiDAR representations are commonly used for monocular 3D object detection. However, methods based on them have shortcomings of either not well capturing the spatial relationships in neighbored image pixels or being…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Liang Peng , Fei Liu , Senbo Yan , Xiaofei He , Deng Cai

Scene flow estimation aims to generate the 3D motion field of points between two consecutive frames of point clouds, which has wide applications in various fields. Existing point-based methods ignore the irregularity of point clouds and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Xuezhi Xiang , Xi Wang , Lei Zhang , Denis Ombati , Himaloy Himu , Xiantong Zhen

The success of deep learning methods led to significant breakthroughs in 3-D point cloud processing tasks with applications in remote sensing. Existing methods utilize convolutions that have some limitations, as they assume a uniform input…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Dimple A Shajahan , Mukund Varma T , Ramanathan Muthuganapathy

Change detection and irregular object extraction in 3D point clouds is a challenging task that is of high importance not only for autonomous navigation but also for updating existing digital twin models of various industrial environments.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Nikolaos Stathoulopoulos , Anton Koval , George Nikolakopoulos

Diffusion Transformers have recently shown remarkable effectiveness in generating high-quality 3D point clouds. However, training voxel-based diffusion models for high-resolution 3D voxels remains prohibitively expensive due to the cubic…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Shentong Mo , Enze Xie , Yue Wu , Junsong Chen , Matthias Nießner , Zhenguo Li

A crucial task in scene understanding is 3D object detection, which aims to detect and localize the 3D bounding boxes of objects belonging to specific classes. Existing 3D object detectors heavily rely on annotated 3D bounding boxes during…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Zengyi Qin , Jinglu Wang , Yan Lu

Due to the success of Bidirectional Encoder Representations from Transformers (BERT) in natural language process (NLP), the multi-head attention transformer has been more and more prevalent in computer-vision researches (CV). However, it…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Weiqiang Jin , Hang Yu , Hang Yu

Query-based transformer has shown great potential in constructing long-range attention in many image-domain tasks, but has rarely been considered in LiDAR-based 3D object detection due to the overwhelming size of the point cloud data. In…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Zixiang Zhou , Xiangchen Zhao , Yu Wang , Panqu Wang , Hassan Foroosh

The point cloud learning community witnesses a modeling shift from CNNs to Transformers, where pure Transformer architectures have achieved top accuracy on the major learning benchmarks. However, existing point Transformers are…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Zhang Cheng , Haocheng Wan , Xinyi Shen , Zizhao Wu

Recently Transformer-based models have advanced point cloud understanding by leveraging self-attention mechanisms, however, these methods often overlook latent information in less prominent regions, leading to increased sensitivity to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Yi Wang , Jiaze Wang , Ziyu Guo , Renrui Zhang , Donghao Zhou , Guangyong Chen , Anfeng Liu , Pheng-Ann Heng

We present Hybrid Voxel Network (HVNet), a novel one-stage unified network for point cloud based 3D object detection for autonomous driving. Recent studies show that 2D voxelization with per voxel PointNet style feature extractor leads to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Maosheng Ye , Shuangjie Xu , Tongyi Cao

3D object detectors usually rely on hand-crafted proxies, e.g., anchors or centers, and translate well-studied 2D frameworks to 3D. Thus, sparse voxel features need to be densified and processed by dense prediction heads, which inevitably…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yukang Chen , Jianhui Liu , Xiangyu Zhang , Xiaojuan Qi , Jiaya Jia

Self-attention networks have revolutionized natural language processing and are making impressive strides in image analysis tasks such as image classification and object detection. Inspired by this success, we investigate the application of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Hengshuang Zhao , Li Jiang , Jiaya Jia , Philip Torr , Vladlen Koltun

LiDAR-based 3D single object tracking is a challenging issue in robotics and autonomous driving. Currently, existing approaches usually suffer from the problem that objects at long distance often have very sparse or partially-occluded point…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Jiayao Shan , Sifan Zhou , Yubo Cui , Zheng Fang

While the Transformer architecture has become ubiquitous in the machine learning field, its adaptation to 3D shape recognition is non-trivial. Due to its quadratic computational complexity, the self-attention operator quickly becomes…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Axel Berg , Magnus Oskarsson , Mark O'Connor

Geometric deep learning is increasingly important thanks to the popularity of 3D sensors. Inspired by the recent advances in NLP domain, the self-attention transformer is introduced to consume the point clouds. We develop Point Attention…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Jiancheng Yang , Qiang Zhang , Bingbing Ni , Linguo Li , Jinxian Liu , Mengdie Zhou , Qi Tian

Most previous 3D object detection methods that leverage the multi-modality of LiDAR and cameras utilize the Bird's Eye View (BEV) space for intermediate feature representation. However, this space uses a low x, y-resolution and sacrifices…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Hyeongseok Son , Jia He , Seung-In Park , Ying Min , Yunhao Zhang , ByungIn Yoo