English
Related papers

Related papers: Align then Adapt: Rethinking Parameter-Efficient T…

200 papers

Transfer learning has become a popular task adaptation method in the era of foundation models. However, many foundation models require large storage and computing resources, which makes off-the-shelf deployment impractical. Post-training…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Jung Hwan Heo , Seyedarmin Azizi , Arash Fayyazi , Massoud Pedram

Pre-trained point cloud models have found extensive applications in 3D understanding tasks like object classification and part segmentation. However, the prevailing strategy of full fine-tuning in downstream tasks leads to large per-task…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Yaohua Zha , Jinpeng Wang , Tao Dai , Bin Chen , Zhi Wang , Shu-Tao Xia

Parameter fine tuning is a transfer learning approach whereby learned parameters from pre-trained source network are transferred to the target network followed by fine-tuning. Prior research has shown that this approach is capable of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Tasfia Shermin , Shyh Wei Teng , Manzur Murshed , Guojun Lu , Ferdous Sohel , Manoranjan Paul

Sequential fine-tuning and multi-task learning are methods aiming to incorporate knowledge from multiple tasks; however, they suffer from catastrophic forgetting and difficulties in dataset balancing. To address these shortcomings, we…

Computation and Language · Computer Science 2021-01-27 Jonas Pfeiffer , Aishwarya Kamath , Andreas Rücklé , Kyunghyun Cho , Iryna Gurevych

While parameter efficient tuning (PET) methods have shown great potential with transformer architecture on Natural Language Processing (NLP) tasks, their effectiveness with large-scale ConvNets is still under-studied on Computer Vision (CV)…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Hao Chen , Ran Tao , Han Zhang , Yidong Wang , Xiang Li , Wei Ye , Jindong Wang , Guosheng Hu , Marios Savvides

Environment perception including detection, classification, tracking, and motion prediction are key enablers for automated driving systems and intelligent transportation applications. Fueled by the advances in sensing technologies and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Zhensong Wei , Xuewei Qi , Zhengwei Bai , Guoyuan Wu , Saswat Nayak , Peng Hao , Matthew Barth , Yongkang Liu , Kentaro Oguchi

Quadruped robots have strong adaptability to extreme environments but may also experience faults. Once these faults occur, robots must be repaired before returning to the task, reducing their practical feasibility. One prevalent concern…

Robotics · Computer Science 2024-01-01 Xinyuan Wu , Wentao Dong , Hang Lai , Yong Yu , Ying Wen

Object reconstruction from 3D point clouds has been a long-standing research problem in computer vision and computer graphics, and achieved impressive progress. However, reconstruction from time-varying point clouds (a.k.a. 4D point clouds)…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Tuan-Anh Vu , Duc Thanh Nguyen , Binh-Son Hua , Quang-Hieu Pham , Sai-Kit Yeung

In computer vision, one is often confronted with problems of domain shifts, which occur when one applies a classifier trained on a source dataset to target data sharing similar characteristics (e.g. same classes), but also different latent…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Bharath Bhushan Damodaran , Benjamin Kellenberger , Rémi Flamary , Devis Tuia , Nicolas Courty

Transfer learning paradigm has driven substantial advancements in various vision tasks. However, as state-of-the-art models continue to grow, classical full fine-tuning often becomes computationally impractical, particularly in multi-task…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Seungmin Baek , Soyul Lee , Hayeon Jo , Hyesong Choi , Dongbo Min

Adapter-based parameter-efficient transfer learning has achieved exciting results in vision-language models. Traditional adapter methods often require training or fine-tuning, facing challenges such as insufficient samples or resource…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Juncheng Yang , Zuchao Li , Shuai Xie , Weiping Zhu , Wei Yu , Shijun Li

The rapid advancement of deep learning models often attributes to their ability to leverage massive training data. In contrast, such privilege has not yet fully benefited 3D deep learning, mainly due to the limited availability of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Xiaoyang Wu , Zhuotao Tian , Xin Wen , Bohao Peng , Xihui Liu , Kaicheng Yu , Hengshuang Zhao

Test-time adaptation (TTA) is a technique used to reduce distribution gaps between the training and testing sets by leveraging unlabeled test data during inference. In this work, we expand TTA to a more practical scenario, where the test…

Machine Learning · Computer Science 2023-03-06 Chenyan Wu , Yimu Pan , Yandong Li , James Z. Wang

Recently, the rise of large-scale vision-language pretrained models like CLIP, coupled with the technology of Parameter-Efficient FineTuning (PEFT), has captured substantial attraction in video action recognition. Nevertheless, prevailing…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Mengmeng Wang , Jiazheng Xing , Boyuan Jiang , Jun Chen , Jianbiao Mei , Xingxing Zuo , Guang Dai , Jingdong Wang , Yong Liu

Current parameter-efficient fine-tuning (PEFT) methods build adapters widely agnostic of the context of downstream task to learn, or the context of important knowledge to maintain. As a result, there is often a performance gap compared to…

Machine Learning · Computer Science 2025-03-11 Yibo Yang , Xiaojie Li , Zhongzhu Zhou , Shuaiwen Leon Song , Jianlong Wu , Liqiang Nie , Bernard Ghanem

3D object detection has become indispensable in the field of autonomous driving. To date, gratifying breakthroughs have been recorded in 3D object detection research, attributed to deep learning. However, deep learning algorithms are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yucheng Zhang , Masaki Fukuda , Yasunori Ishii , Kyoko Ohshima , Takayoshi Yamashita

Category-specific models are provenly valuable methods in 3D single object tracking (SOT) regardless of Siamese or motion-centric paradigms. However, such over-specialized model designs incur redundant parameters, thus limiting the broader…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Jiahao Nie , Zhiwei He , Xudong Lv , Xueyi Zhou , Dong-Kyu Chae , Fei Xie

Understanding spatial dynamics and semantics in point cloud is fundamental for comprehensive 3D comprehension. While reinforcement learning algorithms such as Group Relative Policy Optimization (GRPO) have recently achieved remarkable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yankai Wang , Yiding Sun , Qirui Wang , Pengbo Li , Chaoyi Lu , Dongxu Zhang

Point tracking aims to localize corresponding points across video frames, serving as a fundamental task for 4D reconstruction, robotics, and video editing. Existing methods commonly rely on shallow convolutional backbones such as ResNet…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Soowon Son , Honggyu An , Chaehyun Kim , Hyunah Ko , Jisu Nam , Dahyun Chung , Siyoon Jin , Jung Yi , Jaewon Min , Junhwa Hur , Seungryong Kim

Current state-of-the-art point cloud-based perception methods usually rely on large-scale labeled data, which requires expensive manual annotations. A natural option is to explore the unsupervised methodology for 3D perception tasks.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Jingyu Zhang , Huitong Yang , Dai-Jie Wu , Jacky Keung , Xuesong Li , Xinge Zhu , Yuexin Ma
‹ Prev 1 4 5 6 7 8 10 Next ›