English
Related papers

Related papers: Uncertainty quantification in fine-tuned LLMs usin…

200 papers

Fine-tuning helps large language models (LLM) recover degraded information and enhance task performance. Although Low-Rank Adaptation (LoRA) is widely used and effective for fine-tuning, we have observed that its scaling factor can limit or…

Machine Learning · Computer Science 2025-01-14 Jun Liu , Zhenglun Kong , Peiyan Dong , Changdi Yang , Xuan Shen , Pu Zhao , Hao Tang , Geng Yuan , Wei Niu , Wenbin Zhang , Xue Lin , Dong Huang , Yanzhi Wang

This paper develops an ensemble method for fine-tuning a language model to multiple datasets. Existing methods, such as quantized LoRA (QLoRA), are efficient when adapting to a single dataset. When training on multiple datasets of different…

Machine Learning · Computer Science 2025-05-29 Dongyue Li , Ziniu Zhang , Lu Wang , Hongyang R. Zhang

Fine-tuning large language models (LLMs) with limited data poses a practical challenge in low-resource languages, specialized domains, and constrained deployment settings. While pre-trained LLMs provide strong foundations, effective…

Computation and Language · Computer Science 2025-10-29 Marton Szep , Daniel Rueckert , Rüdiger von Eisenhart-Rothe , Florian Hinterwimmer

Large Language Model (LLM) unlearning aims to remove targeted knowledge from a trained model, but practical deployments often require post-training quantization (PTQ) for efficient inference. However, aggressive low-bit PTQ can mask…

Large language models of high parameter counts are computationally expensive, yet can be made much more efficient by compressing their weights to very low numerical precision. This can be achieved either through post-training quantization…

Machine Learning · Computer Science 2025-04-21 Zifei Xu , Sayeh Sharify , Wanzin Yazar , Tristan Webb , Xin Wang

Accurately quantifying uncertainty in large language models (LLMs) is crucial for their reliable deployment, especially in high-stakes applications. Current state-of-the-art methods for measuring semantic uncertainty in LLMs rely on strict…

Machine Learning · Computer Science 2024-10-31 Yashvir S. Grewal , Edwin V. Bonilla , Thang D. Bui

Generative large language models (LLMs) are a promising alternative to pre-trained language models for entity matching due to their high zero-shot performance and ability to generalize to unseen entities. Existing research on using LLMs for…

Computation and Language · Computer Science 2025-05-22 Aaron Steiner , Ralph Peeters , Christian Bizer

Accurate uncertainty quantification in large language models (LLMs) is essential for reliable confidence estimation, yet fine-tuned LLMs often become overconfident under limited adaptation data. Existing uncertainty methods for PEFT-based…

Machine Learning · Computer Science 2026-05-15 Ruijia Niu , Dongxia Wu , Rose Yu , Yi-An Ma

Reinforcement learning from human feedback (RLHF) emerges as a promising paradigm for aligning large language models (LLMs). However, a notable challenge in RLHF is overoptimization, where beyond a certain threshold, the pursuit of higher…

Machine Learning · Computer Science 2024-01-02 Yuanzhao Zhai , Han Zhang , Yu Lei , Yue Yu , Kele Xu , Dawei Feng , Bo Ding , Huaimin Wang

Low-Rank Adaptation (LoRA) is one of the most widely used techniques for fine-tuning large language models (LLMs). By introducing a small number of trainable low-rank weight matrices, LoRA substantially reduces the number of parameters that…

Machine Learning · Computer Science 2025-07-15 Seokmin Ko

Large Language Models (LLMs) are highly resource-intensive to fine-tune due to their enormous size. While low-rank adaptation is a prominent parameter-efficient fine-tuning approach, it suffers from sensitivity to hyperparameter choices,…

Fine-tuning significantly improves the performance of Large Language Models (LLMs), yet its underlying mechanisms remain poorly understood. This paper aims to provide an in-depth interpretation of the fine-tuning process through circuit…

Computation and Language · Computer Science 2025-06-16 Xu Wang , Yan Hu , Wenyu Du , Reynold Cheng , Benyou Wang , Difan Zou

Fine-tuning adapts a pre-trained model to downstream tasks using a small amount of labeled data. Low-Rank Adaptation (LoRA) is an efficient fine-tuning method that reduces memory and computation costs while often achieving performance close…

Machine Learning · Computer Science 2026-05-20 Ali Zindari , Rotem Mulayoff , Sebastian U. Stich

Large Language Models (LLMs) have been widely employed in programming language analysis to enhance human productivity. Yet, their reliability can be compromised by various code distribution shifts, leading to inconsistent outputs. While…

Software Engineering · Computer Science 2024-02-12 Yufei Li , Simin Chen , Yanghong Guo , Wei Yang , Yue Dong , Cong Liu

We conduct a behavioral exploration of LoRA fine-tuned LLMs for Passage Reranking to understand how relevance signals are learned and deployed by Large Language Models. By fine-tuning Mistral-7B, LLaMA3.1-8B, and Pythia-6.9B on MS MARCO…

Information Retrieval · Computer Science 2025-08-12 Atharva Nijasure , Tanya Chowdhury , James Allan

Though Large Language Models (LLMs) have demonstrated the powerful capabilities of few-shot learning through prompting methods, supervised training is still necessary for complex reasoning tasks. Because of their extensive parameters and…

Computation and Language · Computer Science 2024-06-07 Linhai Zhang , Jialong Wu , Deyu Zhou , Guoqiang Xu

Pre-trained language models (PLMs) have gained increasing popularity due to their compelling prediction performance in diverse natural language processing (NLP) tasks. When formulating a PLM-based prediction pipeline for NLP tasks, it is…

Computation and Language · Computer Science 2022-10-17 Yuxin Xiao , Paul Pu Liang , Umang Bhatt , Willie Neiswanger , Ruslan Salakhutdinov , Louis-Philippe Morency

The proliferation of open-source Large Language Models (LLMs) from various institutions has highlighted the urgent need for comprehensive evaluation methods. However, current evaluation platforms, such as the widely recognized HuggingFace…

Computation and Language · Computer Science 2024-11-01 Fanghua Ye , Mingming Yang , Jianhui Pang , Longyue Wang , Derek F. Wong , Emine Yilmaz , Shuming Shi , Zhaopeng Tu

Large Language Models are known to capture real-world knowledge, allowing them to excel in many downstream tasks. Despite recent advances, these models are still prone to what are commonly known as hallucinations, causing them to emit…

Computation and Language · Computer Science 2025-05-28 Roi Cohen , Omri Fahn , Gerard de Melo

Large language models (LLMs) are being explored for diagnostic decision support, yet their ability to estimate pre-test probabilities, vital for clinical decision-making, remains limited. This study evaluates two LLMs, Mistral-7B and…