English
Related papers

Related papers: Tuning LayerNorm in Attention: Towards Efficient M…

200 papers

Large Language Models (LLMs) are capable of reasoning over diverse input data modalities through pre-trained encoders. However, the growing diversity of input data modalities prevents incorporating all modalities into LLMs, especially when…

Artificial Intelligence · Computer Science 2023-12-14 Kai Huang , Boyuan Yang , Wei Gao

Efficiently post-training large language models remains a challenging task due to the vast computational resources required. We present Spectrum, a method that accelerates LLM training by selectively targeting layer modules based on their…

Machine Learning · Computer Science 2024-06-12 Eric Hartford , Lucas Atkins , Fernando Fernandes Neto , David Golchinfar

Fine-tuning pre-trained large language models (LLMs) with limited hardware presents challenges due to GPU memory constraints. Various distributed fine-tuning methods have been proposed to alleviate memory constraints on GPU. However,…

Artificial Intelligence · Computer Science 2024-04-18 Taeho Kim , Yanming Wang , Vatshank Chaturvedi , Lokesh Gupta , Seyeon Kim , Yongin Kwon , Sangtae Ha

Large Language Models (LLMs) encounter significant performance bottlenecks in long-sequence tasks due to the computational complexity and memory overhead inherent in the self-attention mechanism. To address these challenges, we introduce…

Artificial Intelligence · Computer Science 2026-02-17 Ziming Wang , Xiang Wang , Kailong Peng , Lang Qin , Juan Gabriel Kostelec , Christos Sourmpis , Axel Laborieux , Qinghai Guo

Large language models (LLMs) have revolutionized lots of fields of research. Although it is well-known that fine-tuning is essential for enhancing the capabilities of LLMs, existing research suggests that there is potential redundancy in…

Artificial Intelligence · Computer Science 2025-02-14 Haoling Li , Xin Zhang , Xiao Liu , Yeyun Gong , Yifan Wang , Qi Chen , Peng Cheng

Fine-tuning Large Language Models (LLMs) is now a common approach for text classification in a wide range of applications. When labeled documents are scarce, active learning helps save annotation efforts but requires retraining of massive…

Machine Learning · Computer Science 2024-02-27 Artem Vysogorets , Achintya Gopal

Fine-tuning Large Language Models (LLMs) incurs considerable training costs, driving the need for data-efficient training with optimised data ordering. Human-inspired strategies offer a solution by organising data based on human learning…

Computation and Language · Computer Science 2024-11-06 Yushi Yang , Andrew M. Bean , Robert McCraith , Adam Mahdi

We introduce a large language model (LLM) capable of processing speech inputs and show that tuning it further with reinforcement learning on human preference (RLHF) enables it to adapt better to disordered speech than traditional…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-03 Chirag Nagpal , Subhashini Venugopalan , Jimmy Tobin , Marilyn Ladewig , Katherine Heller , Katrin Tomanek

This paper presents a study on strategies to enhance the translation capabilities of large language models (LLMs) in the context of machine translation (MT) tasks. The paper proposes a novel paradigm consisting of three stages: Secondary…

Computation and Language · Computer Science 2024-04-16 Jiaxin Guo , Hao Yang , Zongyao Li , Daimeng Wei , Hengchao Shang , Xiaoyu Chen

This study proposes a large language model optimization method based on the improved LoRA fine-tuning algorithm, aiming to improve the accuracy and computational efficiency of the model in natural language processing tasks. We fine-tune the…

Computation and Language · Computer Science 2024-12-30 Jiacheng Hu , Xiaoxuan Liao , Jia Gao , Zhen Qi , Hongye Zheng , Chihang Wang

Improving the effectiveness and efficiency of large language models (LLMs) simultaneously is a critical yet challenging research goal. In this paper, we find that low-rank pre-training, normally considered as efficient methods that will…

Computation and Language · Computer Science 2024-11-05 Xingtai Lv , Ning Ding , Kaiyan Zhang , Ermo Hua , Ganqu Cui , Bowen Zhou

Despite being pretrained on multilingual corpora, large language models (LLMs) exhibit suboptimal performance on low-resource languages. Recent approaches have leveraged multilingual encoders alongside LLMs by introducing trainable…

Computation and Language · Computer Science 2025-02-18 Zhiwen Ruan , Yixia Li , He Zhu , Longyue Wang , Weihua Luo , Kaifu Zhang , Yun Chen , Guanhua Chen

During the pretraining phase, large language models (LLMs) acquire vast amounts of knowledge from extensive text corpora. Nevertheless, in later stages such as fine-tuning and inference, the model may encounter knowledge not covered in the…

Computation and Language · Computer Science 2024-10-10 Bozhou Li , Hao Liang , Yang Li , Fangcheng Fu , Hongzhi Yin , Conghui He , Wentao Zhang

Fine-tuning techniques based on Large Pretrained Language Models (LPLMs) have been proven to significantly enhance model performance on a variety of downstream tasks and effectively control the output behaviors of LPLMs. Recent studies have…

Computation and Language · Computer Science 2024-04-02 Yao Liang , Yuwei Wang , Yang Li , Yi Zeng

The fine-tuning of Large Language Models (LLMs) is pivotal for achieving optimal performance across diverse downstream tasks. However, while full fine-tuning delivers superior results, it entails significant computational and resource…

Computation and Language · Computer Science 2025-01-15 Yao Liang , Yuwei Wang , Yi Zeng

Low-Rank Adaptation (LoRA) is the prevailing approach for efficient large language model (LLM) fine-tuning. Building on this paradigm, recent studies have proposed alternative initialization strategies, architectural modifications, and…

Machine Learning · Computer Science 2026-05-20 Yu-Ang Lee , Ching-Yun Ko , Pin-Yu Chen , Mi-Yen Yeh

Recent breakthroughs in Large-scale language models (LLMs) have demonstrated impressive performance on various tasks. The immense sizes of LLMs have led to very high resource demand and cost for running the models. Though the models are…

Machine Learning · Computer Science 2024-03-05 Juntao Zhao , Borui Wan , Yanghua Peng , Haibin Lin , Chuan Wu

Large Language Models (LLMs) have become a cornerstone in Natural Language Processing (NLP), achieving impressive performance in text generation. Their token-level representations capture rich, human-aligned semantics. However, pooling…

Computation and Language · Computer Science 2025-09-25 Benedikt Roth , Stephan Rappensperger , Tianming Qiu , Hamza Imamović , Julian Wörmann , Hao Shen

In the ongoing wave of impact driven by large language models (LLMs) like ChatGPT, the adaptation of LLMs to medical domain has emerged as a crucial research frontier. Since mainstream LLMs tend to be designed for general-purpose…

Computation and Language · Computer Science 2023-12-04 Issey Sukeda , Masahiro Suzuki , Hiroki Sakaji , Satoshi Kodera

Fine-tuning large language models (LLMs) is often limited by the memory available on commodity GPUs. Parameter-efficient fine-tuning (PEFT) methods such as QLoRA reduce the number of trainable parameters, yet still incur high memory usage…

Computation and Language · Computer Science 2025-12-17 Estelle Zheng , Nathan Cerisara , Sébastien Warichet , Emmanuel Helbert , Christophe Cerisara