English
Related papers

Related papers: Sparsely Shared LoRA on Whisper for Child Speech R…

200 papers

Low-Rank Adaptation (LoRA) has emerged as a popular parameter-efficient fine-tuning (PEFT) method for Large Language Models (LLMs), yet it still incurs notable overhead and suffers from parameter interference in multi-task scenarios. We…

Machine Learning · Computer Science 2025-08-05 Juzheng Zhang , Jiacheng You , Ashwinee Panda , Tom Goldstein

LoRA has become a universal Parameter-Efficient Fine-Tuning (PEFT) technique that equips Large Language Models (LLMs) to adapt quickly to new tasks. However, when these models are scaled up, even the latest LoRA variants still introduce…

Computation and Language · Computer Science 2026-02-25 Xindian Ma , Rundong Kong , Peng Zhang , Ruoxiang Huang , Yongyu Jiang

Large pre-trained speech models such as Whisper offer strong generalization but pose significant challenges for resource-efficient adaptation. Low-Rank Adaptation (LoRA) has become a popular parameter-efficient fine-tuning method, yet its…

Sound · Computer Science 2026-01-23 Yujian Ma , Xikun Lu , Jinqiu Sang , Xianquan Jiang , Ruizhe Li

Parameter-Efficient Fine-Tuning (PEFT) methods have transformed the approach to fine-tuning large models for downstream tasks by enabling the adjustment of significantly fewer parameters than those in the original model matrices. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Alessio Quercia , Zhuo Cao , Arya Bangun , Richard D. Paul , Abigail Morrison , Ira Assent , Hanno Scharr

Modern automatic speech recognition (ASR) models, such as OpenAI's Whisper, rely on deep encoder-decoder architectures, and their encoders are a critical bottleneck for efficient deployment due to high computational intensity. We introduce…

Machine Learning · Computer Science 2025-08-26 Keisuke Kamahori , Jungo Kasai , Noriyuki Kojima , Baris Kasikci

Parameter-efficient fine-tuning (PEFT) methods, such as LoRA, offer compact and effective alternatives to full model fine-tuning by introducing low-rank updates to pre-trained weights. However, most existing approaches rely on global low…

Machine Learning · Computer Science 2025-09-25 Babak Barazandeh , Subhabrata Majumdar , Om Rajyaguru , George Michailidis

Parameter-efficient fine-tuning (PEFT) based on low-rank decomposition, such as LoRA, has become a standard for adapting large pretrained models. However, its behavior in sequential learning -- specifically regarding catastrophic forgetting…

Machine Learning · Computer Science 2026-03-11 Muhammad Ahmad , Jingjing Zheng , Yankai Cao

In this paper, we introduce \textbf{Share}d \textbf{Lo}w \textbf{R}ank \textbf{A}daptation (ShareLoRA), a Large Language Model (LLM) fine-tuning technique that balances parameter efficiency, adaptability, and robustness without compromising…

Computation and Language · Computer Science 2025-05-20 Yurun Song , Junchen Zhao , Ian G. Harris , Sangeetha Abdu Jyothi

Fine-tuning large language models is essential for task-specific adaptation, yet it remains computationally prohibitive. Parameter-Efficient Fine-Tuning (PEFT) methods have emerged as a solution, but current approaches typically ignore the…

Computation and Language · Computer Science 2025-12-01 Dayan Pan , Jingyuan Wang , Yilong Zhou , Jiawei Cheng , Pengyue Jia , Xiangyu Zhao

Automatic speech recognition systems have undoubtedly advanced with the integration of multilingual and multitask models such as Whisper, which have shown a promising ability to understand and process speech across a wide range of…

Computation and Language · Computer Science 2025-04-14 Xabier de Zuazo , Eva Navas , Ibon Saratxaga , Inma Hernáez Rioja

This review examines recent advances in Parameter-Efficient Fine-Tuning (PEFT), with a focus on Low-Rank Adaptation (LoRA), to optimize Retrieval-Augmented Generation (RAG) systems like Qwen3, DeepSeek, and Kimi. These systems face…

Computation and Language · Computer Science 2025-08-13 David Santandreu Calonge , Linda Smail

Large language models are often adapted using parameter-efficient techniques such as Low-Rank Adaptation (LoRA), formulated as $y = W_0x + BAx$, where $W_0$ is the pre-trained parameters and $x$ is the input to the adapted layer. While…

Machine Learning · Computer Science 2026-04-28 Hao Ban , Kaiyi Ji

In this paper, Whisper, a large-scale pre-trained model for automatic speech recognition, is proposed to apply to speaker verification. A partial multi-scale feature aggregation (PMFA) approach is proposed based on a subset of Whisper…

Sound · Computer Science 2024-08-29 Yiyang Zhao , Shuai Wang , Guangzhi Sun , Zehua Chen , Chao Zhang , Mingxing Xu , Thomas Fang Zheng

We introduce CoCo-LoRA, a multimodal, uncertainty-aware parameter-efficient fine-tuning method for text prediction tasks accompanied by audio context. Existing PEFT approaches such as LoRA are efficient but typically deterministic, while…

Machine Learning · Computer Science 2026-04-21 Habibeh Naderi , Behrouz Haji Soleimani , Stan Matwin

Low-rank adaptation (LoRA) is a widely used parameter-efficient fine-tuning (PEFT) method that learns weight updates $\Delta W = AB$ for pretrained weights $W$ through low-rank adapters $A$ and $B$. While LoRA ensures hardware efficiency,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yibo Zhong , Jinman Zhao , Yao Zhou

Recently, several approaches successfully demonstrated that weight-sharing Neural Architecture Search (NAS) can effectively explore a search space of elastic low-rank adapters (LoRA), allowing the parameter-efficient fine-tuning (PEFT) and…

Machine Learning · Computer Science 2024-04-18 J. Pablo Muñoz , Jinjie Yuan , Nilesh Jain

Parameter-efficient fine-tuning (PEFT) methods have become the standard paradigm for adapting large-scale models. Among these techniques, Weight-Decomposed Low-Rank Adaptation (DoRA) has been shown to improve both the learning capacity and…

Machine Learning · Computer Science 2026-02-09 Nghiem T. Diep , Hien Dang , Tuan Truong , Tan Dinh , Huy Nguyen , Nhat Ho

Recent advancements in deep learning have significantly enhanced multilingual automatic speech recognition (ASR) due to the development of advanced model architectures and available large-scale multilingual datasets. Despite that,…

Computation and Language · Computer Science 2025-06-30 Jiahong Li , Yiwen Shao , Jianheng Zhuo , Chenda Li , Liliang Tang , Dong Yu , Yanmin Qian

Low-Rank Adaptation (LoRA) is a widely adopted parameter-efficient fine-tuning (PEFT) method. However, its linear adaptation process limits its expressive power. This means there is a gap between the expressive power of linear training and…

Machine Learning · Computer Science 2026-01-06 Jiacheng Li , Jianchao Tan , Zhidong Yang , Feiye Huo , Yerui Sun , Yuchen Xie , Xunliang Cai

Large Language Models (LLMs) have transformed both everyday life and scientific research. However, adapting LLMs from general-purpose models to specialized tasks remains challenging, particularly in resource-constrained environments.…

Machine Learning · Computer Science 2025-09-12 Hao Zhang , Bo Huang , Zhenjia Li , Xi Xiao , Hui Yi Leong , Zumeng Zhang , Xinwei Long , Tianyang Wang , Hao Xu