English
Related papers

Related papers: Efficient Orthogonal Fine-Tuning with Principal Su…

200 papers

Fine-tuning large language models (LLMs) is crucial for improving their performance on downstream tasks, but full-parameter fine-tuning (Full-FT) is computationally expensive and memory-intensive. Parameter-efficient fine-tuning (PEFT)…

Computation and Language · Computer Science 2026-05-12 Longteng Zhang , Lin Zhang , Shaohuai Shi , Xiaowen Chu , Bo Li

Parameter-efficient fine-tuning (PEFT) methods have shown promise in adapting large language models, yet existing approaches exhibit counter-intuitive phenomena: integrating router into prompt tuning (PT) increases training efficiency yet…

Computation and Language · Computer Science 2025-05-15 Zongqian Li , Yixuan Su , Nigel Collier

The world is inherently dynamic, and continual learning aims to enable models to adapt to ever-evolving data streams. While pre-trained models have shown powerful performance in continual learning, they still require finetuning to adapt…

Machine Learning · Computer Science 2026-03-20 Haihua Luo , Xuming Ran , Tommi Kärkkäinen , Huiyan Xue , Zhonghua Chen , Qi Xu , Fengyu Cong

Parameter-efficient fine-tuning (PEFT) methods have provided an effective way for adapting large vision-language models to specific tasks or scenarios. Typically, they learn a very small scale of parameters for pre-trained models in a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Zixian Guo , Yuxiang Wei , Ming Liu , Zhilong Ji , Jinfeng Bai , Yiwen Guo , Wangmeng Zuo

Standard fine-tuning of large pre-trained language models (PLMs) for downstream tasks requires updating hundreds of millions to billions of parameters, and storing a large copy of the PLM weights for every task resulting in increased cost…

Computation and Language · Computer Science 2022-11-03 Yaqing Wang , Sahaj Agarwal , Subhabrata Mukherjee , Xiaodong Liu , Jing Gao , Ahmed Hassan Awadallah , Jianfeng Gao

Standard fine-tuning of large pre-trained language models (PLMs) for downstream tasks requires updating hundreds of millions to billions of parameters, and storing a large copy of the PLM weights for every task resulting in increased cost…

Computation and Language · Computer Science 2022-11-07 Yaqing Wang , Sahaj Agarwal , Subhabrata Mukherjee , Xiaodong Liu , Jing Gao , Ahmed Hassan Awadallah , Jianfeng Gao

Few-shot classification (FSC) entails learning novel classes given only a few examples per class after a pre-training (or meta-training) phase on a set of base classes. Recent works have shown that simply fine-tuning a pre-trained Vision…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Samyadeep Basu , Daniela Massiceti , Shell Xu Hu , Soheil Feizi

The power of foundation models (FMs) lies in their capacity to learn highly expressive representations that can be adapted to a broad spectrum of tasks. However, these pretrained models require additional training stages to become effective…

Machine Learning · Computer Science 2025-10-24 Jacob L. Block , Sundararajan Srinivasan , Liam Collins , Aryan Mokhtari , Sanjay Shakkottai

Large language models have recently surpassed specialized systems on code generation, yet their effectiveness on other code-analysis tasks remains less clear. At the same time, multi-task learning offers a way to unify diverse objectives…

Software Engineering · Computer Science 2026-03-12 Amal Akli , Maxime Cordy , Mike Papadakis , Yves Le Traon

Existing fine-tuning methods either tune all parameters of the pre-trained model (full fine-tuning), which is not efficient, or only tune the last linear layer (linear probing), which suffers a significant accuracy drop compared to the full…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Dongze Lian , Daquan Zhou , Jiashi Feng , Xinchao Wang

Robust fine-tuning aims to achieve competitive in-distribution (ID) performance while maintaining the out-of-distribution (OOD) robustness of a pre-trained model when transferring it to a downstream task. Recently, projected gradient…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Junjiao Tian , Yen-Cheng Liu , James Seale Smith , Zsolt Kira

Parameter-Efficient Fine-Tuning (PEFT) has become a key strategy for adapting large language models, with recent advances in sparse tuning reducing overhead by selectively updating key parameters or subsets of data. Existing approaches…

Machine Learning · Computer Science 2026-03-11 Kai Yao , Zhenghan Song , Kaixin Wu , Mingjie Zhong , Danzhao Cheng , Zhaorui Tan , Yixin Ji , Penglei Gao

Continual table semantic parsing aims to train a parser on a sequence of tasks, where each task requires the parser to translate natural language into SQL based on task-specific tables but only offers limited training examples. Conventional…

Computation and Language · Computer Science 2023-10-10 Yongrui Chen , Shenyu Zhang , Guilin Qi , Xinnan Guo

Large pre-trained models (LPMs) have demonstrated exceptional performance in diverse natural language processing and computer vision tasks. However, fully fine-tuning these models poses substantial memory challenges, particularly in…

Machine Learning · Computer Science 2024-09-12 Chengwei Sun , Jiwei Wei , Yujia Wu , Yiming Shi , Shiyuan He , Zeyu Ma , Ning Xie , Yang Yang

Accurately localizing and segmenting relevant objects from optical remote sensing images (ORSIs) is critical for advancing remote sensing applications. Existing methods are typically built upon moderate-scale pre-trained models and employ…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Yanguang Sun , Chao Wang , Jian Yang , Lei Luo

Parameter-efficient fine-tuning (PEFT) has shown its effectiveness in adapting the pre-trained language models to downstream tasks while only updating a small number of parameters. Despite the success, most existing methods independently…

Computation and Language · Computer Science 2023-11-14 Hao Zhao , Jie Fu , Zhaofeng He

The rapid growth of model scale has necessitated substantial computational resources for fine-tuning. Existing approach such as Low-Rank Adaptation (LoRA) has sought to address the problem of handling the large updated parameters in full…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Yiming Shi , Jiwei Wei , Yujia Wu , Ran Ran , Chengwei Sun , Shiyuan He , Yang Yang

Segmentation is an important analysis task for biomedical images, enabling the study of individual organelles, cells or organs. Deep learning has massively improved segmentation methods, but challenges remain in generalization to new…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Carolin Teuber , Anwai Archit , Constantin Pape

Fine-tuning plays a crucial role in enabling pre-trained LLMs to evolve from general language comprehension to task-specific expertise. To preserve user data privacy, federated fine-tuning is often employed and has emerged as the de facto…

Machine Learning · Computer Science 2025-03-14 Shilong Wang , Jianchun Liu , Hongli Xu , Jiaming Yan , Xianjun Gao

Parameter-efficient fine-tuning (PEFT) has emerged as a scalable solution for adapting large foundation models. While low-rank adaptation (LoRA) is widely used in speech applications, its state-of-the-art variants, e.g., VeRA, DoRA, PiSSA,…

Computation and Language · Computer Science 2025-09-04 Pu Wang , Shinji Watanabe , Hugo Van hamme