English
Related papers

Related papers: Parameter-Efficient Transfer Learning for Music Fo…

200 papers

Federated learning (FL) has emerged as a promising paradigm for enabling the collaborative training of models without centralized access to the raw data on local devices. In the typical FL paradigm (e.g., FedAvg), model weights are sent to…

Machine Learning · Computer Science 2024-12-25 Guangyu Sun , Umar Khalid , Matias Mendieta , Pu Wang , Chen Chen

Recently, prompt tuning (PT) has gained increasing attention as a parameter-efficient way of tuning pre-trained language models (PLMs). Despite extensively reducing the number of tunable parameters and achieving satisfying performance, PT…

Computation and Language · Computer Science 2022-11-15 Yufei Huang , Yujia Qin , Huadong Wang , Yichun Yin , Maosong Sun , Zhiyuan Liu , Qun Liu

Instruction tuning has shown promising potential for developing general-purpose AI capabilities by using large-scale pre-trained models and boosts growing research to integrate multimodal information for creative applications. However,…

Computation and Language · Computer Science 2023-12-21 Yihang Zhai , Haixin Wang , Jianlong Chang , Xinlong Yang , Jinan Sun , Shikun Zhang , Qi Tian

With the continuous growth in the number of parameters of transformer-based pretrained language models (PLMs), particularly the emergence of large language models (LLMs) with billions of parameters, many natural language processing (NLP)…

Computation and Language · Computer Science 2023-12-20 Lingling Xu , Haoran Xie , Si-Zhao Joe Qin , Xiaohui Tao , Fu Lee Wang

Multimodal large language models (MLLMs) fine-tuned with multimodal instruction datasets have demonstrated remarkable capabilities in multimodal tasks. However, fine-tuning all parameters of MLLMs has become challenging as they usually…

Computation and Language · Computer Science 2024-06-10 Xiongtao Zhou , Jie He , Yuhua Ke , Guangyao Zhu , Víctor Gutiérrez-Basulto , Jeff Z. Pan

Foundation models pre-trained on large-scale data have been widely witnessed to achieve success in various natural imaging downstream tasks. Parameter-efficient fine-tuning (PEFT) methods aim to adapt foundation models to new domains by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Wenqiang Zu , Shenghao Xie , Qing Zhao , Guoqi Li , Lei Ma

The rise of deep learning has marked significant progress in fields such as computer vision, natural language processing, and medical imaging, primarily through the adaptation of pre-trained models for specific tasks. Traditional…

Machine Learning · Computer Science 2024-04-25 Charith Chandra Sai Balne , Sreyoshi Bhaduri , Tamoghna Roy , Vinija Jain , Aman Chadha

Instruction tuning has become an important step for finetuning pretrained language models to better follow human instructions and generalize on various tasks. Nowadays, pretrained language models become increasingly larger, and full…

Computation and Language · Computer Science 2024-11-27 Pengfei He

Pre-training & fine-tuning is a prevalent paradigm in computer vision (CV). Recently, parameter-efficient transfer learning (PETL) methods have shown promising performance in adapting to downstream tasks with only a few trainable…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Dongshuo Yin , Xueting Han , Bin Li , Hao Feng , Jing Bai

Parameter-efficient fine-tuning approaches have recently garnered a lot of attention. Having considerably lower number of trainable weights, these methods can bring about scalability and computational effectiveness. In this paper, we look…

Computation and Language · Computer Science 2023-02-23 Mohammad Akbar-Tajari , Sara Rajaee , Mohammad Taher Pilehvar

Fine-tuning of self-supervised models is a powerful transfer learning method in a variety of fields, including speech processing, since it can utilize generic feature representations obtained from large amounts of unlabeled data.…

Multimedia · Computer Science 2022-12-07 Shinta Otake , Rei Kawakami , Nakamasa Inoue

Parameter-efficient transfer learning (PETL) is an emerging research spot aimed at inexpensively adapting large-scale pre-trained models to downstream tasks. Recent advances have achieved great success in saving storage costs for various…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Gen Luo , Minglang Huang , Yiyi Zhou , Xiaoshuai Sun , Guannan Jiang , Zhiyu Wang , Rongrong Ji

Prompt tuning, in which a base pretrained model is adapted to each task via conditioning on learned prompt vectors, has emerged as a promising approach for efficiently adapting large language models to multiple downstream tasks. However,…

Computation and Language · Computer Science 2023-03-07 Zhen Wang , Rameswar Panda , Leonid Karlinsky , Rogerio Feris , Huan Sun , Yoon Kim

Large models represent a groundbreaking advancement in multiple application fields, enabling remarkable achievements across various tasks. However, their unprecedented scale comes with significant computational costs. These models, often…

Machine Learning · Computer Science 2024-09-17 Zeyu Han , Chao Gao , Jinyang Liu , Jeff Zhang , Sai Qian Zhang

Federated Learning (FL) has become an established technique to facilitate privacy-preserving collaborative training across a multitude of clients. However, new approaches to FL often discuss their contributions involving small deep-learning…

Machine Learning · Computer Science 2026-05-05 Herbert Woisetschläger , Alexander Isenko , Shiqiang Wang , Ruben Mayer , Hans-Arno Jacobsen

Parameter-efficient transfer learning (PETL) has shown great potential in adapting a vision transformer (ViT) pre-trained on large-scale datasets to various downstream tasks. Existing studies primarily focus on minimizing the number of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zheng Liu , Jinchao Zhu , Nannan Li , Gao Huang

The latest developments in Natural Language Processing (NLP) have demonstrated remarkable progress in a code-text retrieval problem. As the Transformer-based models used in this task continue to increase in size, the computational costs and…

Machine Learning · Computer Science 2024-05-08 Karim Galliamov , Leila Khaertdinova , Karina Denisova

Performance of neural network models relies on the availability of large datasets with minimal levels of uncertainty. Transfer Learning (TL) models have been proposed to resolve the issue of small dataset size by letting the model train on…

Beat tracking is a widely researched topic in music information retrieval. However, current beat tracking methods face challenges due to the scarcity of labeled data, which limits their ability to generalize across diverse musical styles…

Sound · Computer Science 2025-09-10 Ganghui Ru , Jieying Wang , Jiahao Zhao , Yulun Wu , Yi Yu , Nannan Jiang , Wei Wang , Wei Li

Adapting vision transformer foundation models through parameter-efficient fine-tuning (PEFT) methods has become increasingly popular. These methods optimize a limited subset of parameters, enabling efficient adaptation without the need to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Son Thai Ly , Hien V. Nguyen