English
Related papers

Related papers: Spatial-Temporal Transformer for 3D Point Cloud Se…

200 papers

Feature learning for 3D object detection from point clouds is very challenging due to the irregularity of 3D point cloud data. In this paper, we propose Pointformer, a Transformer backbone designed for 3D point clouds to learn features…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Xuran Pan , Zhuofan Xia , Shiji Song , Li Erran Li , Gao Huang

Transformers have shown superior performance on various computer vision tasks with their capabilities to capture long-range dependencies. Despite the success, it is challenging to directly apply Transformers on point clouds due to their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Jinyoung Park , Sanghyeok Lee , Sihyeon Kim , Yunyang Xiong , Hyunwoo J. Kim

Although the application of Transformers in 3D point cloud processing has achieved significant progress and success, it is still challenging for existing 3D Transformer methods to efficiently and accurately learn both valuable global…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Dening Lu , Kyle Gao , Qian Xie , Linlin Xu , Jonathan Li

Exploring contextual information in the local region is important for shape understanding and analysis. Existing studies often employ hand-crafted or explicit ways to encode contextual information of local regions. However, it is hard to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Xinhai Liu , Zhizhong Han , Yu-Shen Liu , Matthias Zwicker

Instance segmentation in point clouds is one of the most fine-grained ways to understand the 3D scene. Due to its close relationship to semantic segmentation, many works approach these two tasks simultaneously and leverage the benefits of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Guangnan Wu , Zhiyi Pan , Peng Jiang , Changhe Tu

Processing 3D data efficiently has always been a challenge. Spatial operations on large-scale point clouds, stored as sparse data, require extra cost. Attracted by the success of transformers, researchers are using multi-head attention for…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Mahdi Saleh , Yige Wang , Nassir Navab , Benjamin Busam , Federico Tombari

3D point cloud segmentation has made tremendous progress in recent years. Most current methods focus on aggregating local features, but fail to directly model long-range dependencies. In this paper, we propose Stratified Transformer that is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Xin Lai , Jianhui Liu , Li Jiang , Liwei Wang , Hengshuang Zhao , Shu Liu , Xiaojuan Qi , Jiaya Jia

3D convolutional neural networks have achieved promising results for video tasks in computer vision, including video saliency prediction that is explored in this paper. However, 3D convolution encodes visual representation merely on fixed…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Ziqiang Wang , Zhi Liu , Gongyang Li , Yang Wang , Tianhong Zhang , Lihua Xu , Jijun Wang

Transformers have become the primary backbone of the computer vision community due to their impressive performance. However, the unfriendly computation cost impedes their potential in the video recognition domain. To optimize the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Shuangrui Ding , Peisen Zhao , Xiaopeng Zhang , Rui Qian , Hongkai Xiong , Qi Tian

Recent works of point clouds show that mulit-frame spatio-temporal modeling outperforms single-frame versions by utilizing cross-frame information. In this paper, we further improve spatio-temporal point cloud feature learning with a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Hanwen Cao , Yongyi Lu , Cewu Lu , Bo Pang , Gongshen Liu , Alan Yuille

As a pioneering work exploring transformer architecture for 3D point cloud understanding, Point Transformer achieves impressive results on multiple highly competitive benchmarks. In this work, we analyze the limitations of the Point…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Xiaoyang Wu , Yixing Lao , Li Jiang , Xihui Liu , Hengshuang Zhao

Sound event localization and detection (SELD) is a task for the classification of sound events and the identification of direction of arrival (DoA) utilizing multichannel acoustic signals. For effective classification and localization, a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-18 Yusun Shul , Dayun Choi , Jung-Woo Choi

Self-attention modules have demonstrated remarkable capabilities in capturing long-range relationships and improving the performance of point cloud tasks. However, point cloud objects are typically characterized by complex, disordered, and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Xian Wei , Muyu Wang , Shing-Ho Jonathan Lin , Zhengyu Li , Jian Yang , Arafat Al-Jawari , Xuan Tang

In this paper, we propose a novel feature learning framework for video person re-identification (re-ID). The proposed framework largely aims to exploit the adequate temporal information of video sequences and tackle the poor spatial…

Computer Vision and Pattern Recognition · Computer Science 2018-12-26 Ju Dai , Pingping Zhang , Huchuan Lu , Hongyu Wang

Spatiotemporal predictive learning aims to generate future frames by learning from historical frames. In this paper, we investigate existing methods and present a general framework of spatiotemporal predictive learning, in which the spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Cheng Tan , Zhangyang Gao , Lirong Wu , Yongjie Xu , Jun Xia , Siyuan Li , Stan Z. Li

The recently developed pure Transformer architectures have attained promising accuracy on point cloud learning benchmarks compared to convolutional neural networks. However, existing point cloud Transformers are computationally expensive…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Cheng Zhang , Haocheng Wan , Xinyi Shen , Zizhao Wu

Deep neural networks are widely used for understanding 3D point clouds. At each point convolution layer, features are computed from local neighborhoods of 3D points and combined for subsequent processing in order to extract semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Jiayun Wang , Rudrasis Chakraborty , Stella X. Yu

3D single object tracking with point clouds is a critical task in 3D computer vision. Previous methods usually input the last two frames and use the predicted box to get the template point cloud in previous frame and the search area point…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Yubo Cui , Zhiheng Li , Zheng Fang

Recently, the community has made tremendous progress in developing effective methods for point cloud video understanding that learn from massive amounts of labeled data. However, annotating point cloud videos is usually notoriously…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Zhiqiang Shen , Xiaoxiao Sheng , Hehe Fan , Longguang Wang , Yulan Guo , Qiong Liu , Hao Wen , Xi Zhou

Given the rapid development of 3D scanners, point clouds are becoming popular in AI-driven machines. However, point cloud data is inherently sparse and irregular, causing significant difficulties for machine perception. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Shi Qiu , Saeed Anwar , Nick Barnes