English
Related papers

Related papers: Towards Large-scale 3D Representation Learning wit…

200 papers

Nowadays, pre-training big models on large-scale datasets has become a crucial topic in deep learning. The pre-trained models with high representation ability and transferability achieve a great success and dominate many downstream tasks in…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Ziyi Wang , Xumin Yu , Yongming Rao , Jie Zhou , Jiwen Lu

This paper takes a parallel learning approach for robust and transparent AI. A deep neural network is trained in parallel on multiple tasks, where each task is trained only on a subset of the network resources. Each subset consists of…

The popularity of pre-trained large models has revolutionized downstream tasks across diverse fields, such as language, vision, and multi-modality. To minimize the adaption cost for downstream tasks, many Parameter-Efficient Fine-Tuning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yiwen Tang , Ray Zhang , Zoey Guo , Dong Wang , Zhigang Wang , Bin Zhao , Xuelong Li

Remarkable performance from Transformer networks in Natural Language Processing promote the development of these models in dealing with computer vision tasks such as image recognition and segmentation. In this paper, we introduce a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Qi Zhong , Xian-Feng Han

Data-driven methods have become increasingly more prominent for musculoskeletal modelling due to their conceptually intuitive simple and fast implementation. However, the performance of a pre-trained data-driven model using the data from…

Signal Processing · Electrical Eng. & Systems 2022-11-23 Jie Zhang , Yihui Zhao , Tianzhe Bao , Zhenhong Li , Kun Qian , Alejandro F. Frangi , Sheng Quan Xie , Zhi-Qiang Zhang

Recently, Synthetic data-based Instance Segmentation has become an exceedingly favorable optimization paradigm since it leverages simulation rendering and physics to generate high-quality image-annotation pairs. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Ming Li , Jie Wu , Jinhang Cai , Jie Qin , Yuxi Ren , Xuefeng Xiao , Min Zheng , Rui Wang , Xin Pan

We present Uni$^2$Det, a brand new framework for unified and universal multi-dataset training on 3D detection, enabling robust performance across diverse domains and generalization to unseen domains. Due to substantial disparities in data…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yubin Wang , Zhikang Zou , Xiaoqing Ye , Xiao Tan , Errui Ding , Cairong Zhao

Prompt tuning, a parameter- and data-efficient transfer learning paradigm that tunes only a small number of parameters in a model's input space, has become a trend in the vision community since the emergence of large vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Yuhang Zang , Wei Li , Kaiyang Zhou , Chen Huang , Chen Change Loy

Currently, under supervised learning, a model pretrained by a large-scale nature scene dataset and then fine-tuned on a few specific task labeling data is the paradigm that has dominated the knowledge transfer learning. It has reached the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Tong Zhang , Peng Gao , Hao Dong , Yin Zhuang , Guanqun Wang , Wei Zhang , He Chen

Few-shot learning aims to fast adapt a deep model from a few examples. While pre-training and meta-training can create deep models powerful for few-shot generalization, we find that pre-training and meta-training focuses respectively on…

Machine Learning · Computer Science 2022-12-20 Yang Shu , Zhangjie Cao , Jinghan Gao , Jianmin Wang , Philip S. Yu , Mingsheng Long

Semantic understanding of 3D point clouds is important for various robotics applications. Given that point-wise semantic annotation is expensive, in this paper, we address the challenge of learning models with extremely sparse labels. The…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Liyi Luo , Beiwen Tian , Hao Zhao , Guyue Zhou

Recent advances in decentralized deep learning algorithms have demonstrated cutting-edge performance on various tasks with large pre-trained models. However, a pivotal prerequisite for achieving this level of competitiveness is the…

Machine Learning · Computer Science 2024-04-15 Nastaran Saadati , Minh Pham , Nasla Saleem , Joshua R. Waite , Aditya Balu , Zhanhong Jiang , Chinmay Hegde , Soumik Sarkar

Representation learning has been proven to play an important role in the unprecedented success of machine learning models in numerous tasks, such as machine translation, face recognition and recommendation. The majority of existing…

Machine Learning · Computer Science 2020-09-24 Wentao Wang , Guowei Xu , Wenbiao Ding , Gale Yan Huang , Guoliang Li , Jiliang Tang , Zitao Liu

Point clouds provide a flexible and natural representation usable in countless applications such as robotics or self-driving cars. Recently, deep neural networks operating on raw point cloud data have shown promising results on supervised…

Machine Learning · Computer Science 2019-06-04 Jonathan Sauder , Bjarne Sievers

Self-supervised learning has proved effective for skeleton-based human action understanding, which is an important yet challenging topic. Previous works mainly rely on contrastive learning or masked motion modeling paradigm to model the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Jiahang Zhang , Lilang Lin , Jiaying Liu

Personalizing diffusion models using limited data presents significant challenges, including overfitting, loss of prior knowledge, and degradation of text alignment. Overfitting leads to shifts in the noise prediction distribution,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 JungWoo Chae , Jiyoon Kim , JaeWoong Choi , Kyungyul Kim , Sangheum Hwang

Point cloud based 3D deep model has wide applications in many applications such as autonomous driving, house robot, and so on. Inspired by the recent prompt learning in natural language processing, this work proposes a novel Multi-view…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Haoyang Peng , Baopu Li , Bo Zhang , Xin Chen , Tao Chen , Hongyuan Zhu

We present Point-BERT, a new paradigm for learning Transformers to generalize the concept of BERT to 3D point cloud. Inspired by BERT, we devise a Masked Point Modeling (MPM) task to pre-train point cloud Transformers. Specifically, we…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Xumin Yu , Lulu Tang , Yongming Rao , Tiejun Huang , Jie Zhou , Jiwen Lu

We propose self-adaptive training -- a unified training algorithm that dynamically calibrates and enhances training processes by model predictions without incurring an extra computational cost -- to advance both supervised and…

Machine Learning · Computer Science 2022-10-17 Lang Huang , Chao Zhang , Hongyang Zhang

Prompt-based fine-tuning has boosted the performance of Pre-trained Language Models (PLMs) on few-shot text classification by employing task-specific prompts. Yet, PLMs are unfamiliar with prompt-style expressions during pre-training, which…

Computation and Language · Computer Science 2022-05-12 Jianing Wang , Chengyu Wang , Fuli Luo , Chuanqi Tan , Minghui Qiu , Fei Yang , Qiuhui Shi , Songfang Huang , Ming Gao