English
Related papers

Related papers: Transfer Learning with Point Transformers

200 papers

Transformers have attracted increasing interests in computer vision, but they still fall behind state-of-the-art convolutional networks. In this work, we show that while Transformers tend to have larger model capacity, their generalization…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Zihang Dai , Hanxiao Liu , Quoc V. Le , Mingxing Tan

We propose an efficient transfer learning method for adapting ImageNet pre-trained Convolutional Neural Network (CNN) to fine-grained image classification task. Conventional transfer learning methods typically face the trade-off between…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Xiangxi Mo , Ruizhe Cheng , Tianyi Fang

Point clouds provide a flexible and natural representation usable in countless applications such as robotics or self-driving cars. Recently, deep neural networks operating on raw point cloud data have shown promising results on supervised…

Machine Learning · Computer Science 2019-06-04 Jonathan Sauder , Bjarne Sievers

Transformers have been seldom employed in point cloud roof plane instance segmentation, which is the focus of this study, and existing superpoint Transformers suffer from limited performance due to the use of low-quality superpoints. To…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Cheng Zeng , Xiatian Qi , Chi Chen , Kai Sun , Wangle Zhang , Yuxuan Liu , Yan Meng , Bisheng Yang

In a point cloud sequence, 3D object tracking aims to predict the location and orientation of an object in the current search point cloud given a template point cloud. Motivated by the success of transformers, we propose Point Tracking…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Changqing Zhou , Zhipeng Luo , Yueru Luo , Tianrui Liu , Liang Pan , Zhongang Cai , Haiyu Zhao , Shijian Lu

Deep transfer learning recently has acquired significant research interest. It makes use of pre-trained models that are learned from a source domain, and utilizes these models for the tasks in a target domain. Model-based deep transfer…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Tianyang Wang , Jun Huan , Michelle Zhu

Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiquan Ngiam , Daiyi Peng , Vijay Vasudevan , Simon Kornblith , Quoc V. Le , Ruoming Pang

Transformer-based models for transfer learning have the potential to achieve high prediction accuracies on text-based supervised learning tasks with relatively few training data instances. These models are thus likely to benefit social…

Computation and Language · Computer Science 2022-09-01 Sandra Wankmüller

Deep neural networks are widely used for understanding 3D point clouds. At each point convolution layer, features are computed from local neighborhoods of 3D points and combined for subsequent processing in order to extract semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Jiayun Wang , Rudrasis Chakraborty , Stella X. Yu

We present a novel attention-based mechanism to learn enhanced point features for point cloud processing tasks, e.g., classification and segmentation. Unlike prior works, which were trained to optimize the weights of a pre-selected set of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Liqiang Lin , Pengdi Huang , Chi-Wing Fu , Kai Xu , Hao Zhang , Hui Huang

3D point cloud semantic segmentation aims to group all points into different semantic categories, which benefits important applications such as point cloud scene reconstruction and understanding. Existing supervised point cloud semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Canyu Zhang , Zhenyao Wu , Xinyi Wu , Ziyu Zhao , Song Wang

Transformers have been successfully used in various fields and are becoming the standard tools in computer vision. However, self-attention, a core component of transformers, has a quadratic complexity problem, which limits the use of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Jiuk Hong , Chaehyeon Lee , Soyoun Bang , Heechul Jung

Recently multimodal transformer models have gained popularity because their performance on language and vision tasks suggest they learn rich visual-linguistic representations. Focusing on zero-shot image retrieval tasks, we study three…

Computation and Language · Computer Science 2021-02-02 Lisa Anne Hendricks , John Mellor , Rosalia Schneider , Jean-Baptiste Alayrac , Aida Nematzadeh

Transformers have been at the heart of the Natural Language Processing (NLP) and Computer Vision (CV) revolutions. The significant success in NLP and CV inspired exploring the use of Transformers in point cloud processing. However, how do…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Dening Lu , Qian Xie , Mingqiang Wei , Kyle Gao , Linlin Xu , Jonathan Li

Few prior works study deep learning on point sets. PointNet by Qi et al. is a pioneer in this direction. However, by design PointNet does not capture local structures induced by the metric space points live in, limiting its ability to…

Computer Vision and Pattern Recognition · Computer Science 2017-06-09 Charles R. Qi , Li Yi , Hao Su , Leonidas J. Guibas

Latent space model plays a crucial role in network analysis, and accurate estimation of latent variables is essential for downstream tasks such as link prediction. However, the large number of parameters to be estimated presents a…

Methodology · Statistics 2025-09-22 Kuangnan Fang , Ruixuan Qin , Xinyan Fan

Deep neural networks produce state-of-the-art results when trained on a large number of labeled examples but tend to overfit when small amounts of labeled examples are used for training. Creating a large number of labeled examples requires…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Attaullah Sahito , Eibe Frank , Bernhard Pfahringer

The significant effort required to annotate data for new training datasets hinders computer vision research and machine learning in the construction industry. This work explores adapting standard datasets and the latest transformer model…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Lukas Rauch , Thomas Braml

The change point is a moment of an abrupt alteration in the data distribution. Current methods for change point detection are based on recurrent neural methods suitable for sequential data. However, recent works show that transformers based…

Machine Learning · Computer Science 2022-04-19 Anna Dmitrienko , Evgenia Romanenkova , Alexey Zaytsev

Point cloud video understanding is critical for robotics as it accurately encodes motion and scene interaction. We recognize that 4D datasets are far scarcer than 3D ones, which hampers the scalability of self-supervised 4D models. A…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Yiding Sun , Jihua Zhu , Haozhe Cheng , Chaoyi Lu , Zhichuan Yang , Lin Chen , Yaonan Wang