English
Related papers

Related papers: PointTransformerX: Portable and Efficient 3D Point…

200 papers

Embodied intelligence requires agents to interact with 3D environments in real time based on language instructions. A foundational task in this domain is ego-centric 3D visual grounding. However, the point clouds rendered from RGB-D images…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Qihang Peng , Henry Zheng , Gao Huang

Point transformers have demonstrated remarkable progress in 3D understanding through expanded receptive fields (RF), but further expanding the RF leads to dilution in group attention and decreases detailed feature extraction capability.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Jiaxu Wan , Hong Zhang , Ziqi He , Yangyan Deng , Qishu Wang , Ding Yuan , Yifan Yang

Deep learning on point clouds plays a vital role in a wide range of applications such as autonomous driving and AR/VR. These applications interact with people in real-time on edge devices and thus require low latency and low energy.…

Hardware Architecture · Computer Science 2021-10-15 Yujun Lin , Zhekai Zhang , Haotian Tang , Hanrui Wang , Song Han

Recently, there have been some attempts of Transformer in 3D point cloud classification. In order to reduce computations, most existing methods focus on local spatial attention, but ignore their content and fail to establish relationships…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yahui Liu , Bin Tian , Yisheng Lv , Lingxi Li , Feiyue Wang

With the increased interest in immersive experiences, point cloud came to birth and was widely adopted as the first choice to represent 3D media. Besides several distortions that could affect the 3D content spanning from acquisition to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Marouane Tliba , Aladine Chetouani , Giuseppe Valenzise , Frederic Dufaux

In recent years, point cloud analysis methods based on the Transformer architecture have made significant progress, particularly in the context of multimedia applications such as 3D modeling, virtual reality, and autonomous systems.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qiang Zheng , Chao Zhang , Jian Sun

With the prevalence of LiDAR sensors in autonomous driving, 3D object tracking has received increasing attention. In a point cloud sequence, 3D object tracking aims to predict the location and orientation of an object in consecutive frames…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Zhipeng Luo , Changqing Zhou , Liang Pan , Gongjie Zhang , Tianrui Liu , Yueru Luo , Haiyu Zhao , Ziwei Liu , Shijian Lu

The evolution of 3D visualization techniques has fundamentally transformed how we interact with digital content. At the forefront of this change is point cloud technology, offering an immersive experience that surpasses traditional 2D…

Multimedia · Computer Science 2025-01-10 Xiao Huo , Junhui Hou , Shuai Wan , Fuzheng Yang

We propose octree-based transformers, named OctFormer, for 3D point cloud learning. OctFormer can not only serve as a general and effective backbone for 3D point cloud segmentation and object detection but also have linear complexity and is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Peng-Shuai Wang

Recent Transformer-based 3D object detectors learn point cloud features either from point- or voxel-based representations. However, the former requires time-consuming sampling while the latter introduces quantization errors. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Honghui Yang , Wenxiao Wang , Minghao Chen , Binbin Lin , Tong He , Hua Chen , Xiaofei He , Wanli Ouyang

As a pioneering work exploring transformer architecture for 3D point cloud understanding, Point Transformer achieves impressive results on multiple highly competitive benchmarks. In this work, we analyze the limitations of the Point…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Xiaoyang Wu , Yixing Lao , Li Jiang , Xihui Liu , Hengshuang Zhao

The past few years have witnessed the great success and prevalence of self-supervised representation learning within the language and 2D vision communities. However, such advancements have not been fully migrated to the field of 3D point…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Qijian Zhang , Junhui Hou

Point cloud registration is a fundamental technique in 3-D computer vision with applications in graphics, autonomous driving, and robotics. However, registration tasks under challenging conditions, under which noise or perturbations are…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Rui She , Qiyu Kang , Sijie Wang , Wee Peng Tay , Kai Zhao , Yang Song , Tianyu Geng , Yi Xu , Diego Navarro Navarro , Andreas Hartmannsgruber

Thanks to its precise spatial referencing, 3D point cloud visual grounding is essential for deep understanding and dynamic interaction in 3D environments, encompassing 3D Referring Expression Comprehension (3DREC) and Segmentation (3DRES).…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Haojia Lin , Yongdong Luo , Xiawu Zheng , Lijiang Li , Fei Chao , Taisong Jin , Donghao Luo , Yan Wang , Liujuan Cao , Rongrong Ji

In point cloud analysis, point-based methods have rapidly developed in recent years. These methods have recently focused on concise MLP structures, such as PointNeXt, which have demonstrated competitiveness with Convolutional and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Xin Deng , WenYu Zhang , Qing Ding , XinMing Zhang

The conventional pose estimation of a 3D object usually requires the knowledge of the 3D model of the object. Even with the recent development in convolutional neural networks (CNNs), a 3D model is often necessary in the final estimation.…

Robotics · Computer Science 2019-01-01 Zhongang Cai , Cunjun Yu , Quang-Cuong Pham

To apply transformer-based models to point cloud understanding, many previous works modify the architecture of transformers by using, e.g., local attention and down-sampling. Although they have achieved promising results, earlier works on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Lanxiao Li , Michael Heizmann

Deep learning on point clouds has received increased attention thanks to its wide applications in AR/VR and autonomous driving. These applications require low latency and high accuracy to provide real-time user experience and ensure user…

Machine Learning · Computer Science 2022-04-22 Haotian Tang , Zhijian Liu , Xiuyu Li , Yujun Lin , Song Han

Transformer has demonstrated promising performance in many 2D vision tasks. However, it is cumbersome to compute the self-attention on large-scale point cloud data because point cloud is a long sequence and unevenly distributed in 3D space.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Chenhang He , Ruihuang Li , Shuai Li , Lei Zhang

Designing an efficient yet deployment-friendly 3D backbone to handle sparse point clouds is a fundamental problem in 3D perception. Compared with the customized sparse convolution, the attention mechanism in Transformers is more appropriate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Haiyang Wang , Chen Shi , Shaoshuai Shi , Meng Lei , Sen Wang , Di He , Bernt Schiele , Liwei Wang