English
Related papers

Related papers: ADePT: Adaptive Decomposed Prompt Tuning for Param…

200 papers

Benefiting from prompt tuning, recent years have witnessed the promising performance of pre-trained vision-language models, e.g., CLIP, on versatile downstream tasks. In this paper, we focus on a particular setting of learning adaptive…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Chun-Mei Feng , Kai Yu , Yong Liu , Salman Khan , Wangmeng Zuo

An exciting advancement in the field of multilingual models is the emergence of autoregressive models with zero- and few-shot capabilities, a phenomenon widely reported in large-scale language models. To further improve model adaptation to…

Computation and Language · Computer Science 2023-11-15 Nohil Park , Joonsuk Park , Kang Min Yoo , Sungroh Yoon

Parameter-efficient tuning (PET) aims to transfer pre-trained foundation models to downstream tasks by learning a small number of parameters. Compared to traditional fine-tuning, which updates the entire model, PET significantly reduces…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Kwonyoung Kim , Jungin Park , Jin Kim , Hyeongjun Kwon , Kwanghoon Sohn

Despite demonstrating superior performance across a variety of linguistic tasks, pre-trained large language models (LMs) often require fine-tuning on specific datasets to effectively address different downstream tasks. However, fine-tuning…

Computation and Language · Computer Science 2024-10-02 Zhidong Gao , Yu Zhang , Zhenxiao Zhang , Yanmin Gong , Yuanxiong Guo

Text-rich graphs, which exhibit rich textual information on nodes and edges, are prevalent across a wide range of real-world business applications. Large Language Models (LLMs) have demonstrated remarkable abilities in understanding text,…

Computation and Language · Computer Science 2024-04-30 Qi Zhu , Da Zheng , Xiang Song , Shichang Zhang , Bowen Jin , Yizhou Sun , George Karypis

Compared to Full-Model Fine-Tuning (FMFT), Parameter Efficient Fine-Tuning (PEFT) has demonstrated superior performance and lower computational overhead in several code understanding tasks, such as code summarization and code search. This…

Software Engineering · Computer Science 2024-02-12 Shuo Liu , Jacky Keung , Zhen Yang , Fang Liu , Qilin Zhou , Yihan Liao

Multi-prompt learning methods have emerged as an effective approach for facilitating the rapid adaptation of vision-language models to downstream tasks with limited resources. Existing multi-prompt learning methods primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Fei Song , Yi Li , Jiangmeng Li , Rui Wang , Changwen Zheng , Fanjiang Xu , Hui Xiong

Prompt tuning (PT), as an emerging resource-efficient fine-tuning paradigm, has showcased remarkable effectiveness in improving the task-specific transferability of vision-language models. This paper delves into a previously overlooked…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Fei Zhang , Tianfei Zhou , Jiangchao Yao , Ya Zhang , Ivor W. Tsang , Yanfeng Wang

Prompt learning has emerged as an efficient and effective approach for transferring foundational Vision-Language Models (e.g., CLIP) to downstream tasks. However, current methods tend to overfit to seen categories, thereby limiting their…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Chen Xu , Yuhan Zhu , Guozhen Zhang , Haocheng Shen , Yixuan Liao , Xiaoxin Chen , Gangshan Wu , Limin Wang

Large-scale multilingual ASR models like Whisper excel in high-resource settings but face challenges in low-resource scenarios, such as rare languages and code-switching (CS), due to computational costs and catastrophic forgetting. We…

Computation and Language · Computer Science 2025-09-29 Hongli Yang , Yizhou Peng , Hao Huang , Sheng Li

Pre-trained vision-language models (e.g., CLIP) have shown promising zero-shot generalization in many downstream tasks with properly designed text prompts. Instead of relying on hand-engineered prompts, recent works learn prompts using the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Manli Shu , Weili Nie , De-An Huang , Zhiding Yu , Tom Goldstein , Anima Anandkumar , Chaowei Xiao

Prompt tuning is one of the successful approaches for parameter-efficient tuning of pre-trained language models. Despite being arguably the most parameter-efficient (tuned soft prompts constitute <0.1% of total parameters), it typically…

Computation and Language · Computer Science 2023-05-09 Anastasia Razdaibiedina , Yuning Mao , Rui Hou , Madian Khabsa , Mike Lewis , Jimmy Ba , Amjad Almahairi

Vision-language models (VLMs) have demonstrated exceptional generalization capabilities for downstream tasks. Due to its efficiency, prompt learning has gradually become a more effective and efficient method for transferring VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Chenhao Ding , Xinyuan Gao , Songlin Dong , Jizhou Han , Qiang Wang , Zhengdong Zhou , Yuhang He , Yihong Gong

Prompt-tuning (PT) for large language models (LLMs) can facilitate the performance on various conventional NLP tasks with significantly fewer trainable parameters. However, our investigation reveals that PT provides limited improvement and…

Computation and Language · Computer Science 2025-04-15 Sinan Fan , Liang Xie , Chen Shen , Ge Teng , Xiaosong Yuan , Xiaofeng Zhang , Chenxi Huang , Wenxiao Wang , Xiaofei He , Jieping Ye

Prompt tuning offers a parameter-efficient way to adapt large pre-trained language models to new tasks, but most existing approaches are designed for single-task settings, failing to share knowledge across related tasks. We propose…

Computation and Language · Computer Science 2025-09-19 Ahmad Pouramini , Hesham Faili

Point cloud analysis has achieved outstanding performance by transferring point cloud pre-trained models. However, existing methods for model adaptation usually update all model parameters, i.e., full fine-tuning paradigm, which is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Xin Zhou , Dingkang Liang , Wei Xu , Xingkui Zhu , Yihan Xu , Zhikang Zou , Xiang Bai

Prompt-based learning has emerged as a parameter-efficient finetuning (PEFT) approach to facilitate Large Language Model (LLM) adaptation to downstream tasks by conditioning generation with task-aware guidance. Despite its successes,…

Computation and Language · Computer Science 2025-10-21 Yiyang Liu , James C. Liang , Heng Fan , Wenhao Yang , Yiming Cui , Xiaotian Han , Lifu Huang , Dongfang Liu , Qifan Wang , Cheng Han

Language model-based code generation and completion tools have been widely adopted, but they may sometimes produce code that does not meet necessary constraints, such as syntactic correctness or API existence. Constrained decoding…

Software Engineering · Computer Science 2025-10-21 Yongmin Li , Jia Li , Ge Li , Zhi Jin

The success of large-scale pre-trained models has established fine-tuning as a standard method for achieving significant improvements in downstream tasks. However, fine-tuning the entire parameter set of a pre-trained model is costly.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Yijin Huang , Pujin Cheng , Roger Tam , Xiaoying Tang

Parameter-Efficient Fine-Tuning (PEFT) method has emerged as a dominant paradigm for adapting pre-trained GNN models to downstream tasks. However, existing PEFT methods usually exhibit significant vulnerability to various noise and attacks…

Machine Learning · Computer Science 2026-01-05 Ziyan Zhang , Bo Jiang , Jin Tang