English
Related papers

Related papers: Instruction Finetuning LLaMA-3-8B Model Using LoRA…

200 papers

AI developers often apply safety alignment procedures to prevent the misuse of their AI systems. For example, before Meta released Llama 2-Chat - a collection of instruction fine-tuned large language models - they invested heavily in safety…

Machine Learning · Computer Science 2024-05-24 Simon Lermen , Charlie Rogers-Smith , Jeffrey Ladish

Fine-tuning large language models (LLMs) with low-rank adaptation (LoRA) is a cost-effective way to incorporate information from a specific dataset. However, when a problem requires incorporating information from multiple datasets - as in…

Machine Learning · Computer Science 2026-04-03 Liyi Zhang , Jake Snell , Thomas L. Griffiths

Although the advancements of pre-trained Large Language Models have significantly accelerated recent progress in NLP, their ever-increasing size poses significant challenges for conventional fine-tuning, especially in memory-intensive…

Computation and Language · Computer Science 2024-04-02 Chenxi Whitehouse , Fantine Huot , Jasmijn Bastings , Mostafa Dehghani , Chu-Cheng Lin , Mirella Lapata

Named entity recognition (NER) is evolving from a sequence labeling task into a generative paradigm with the rise of large language models (LLMs). We conduct a systematic evaluation of open-source LLMs on both flat and nested NER tasks. We…

Computation and Language · Computer Science 2026-01-27 Qi Zhan , Yile Wang , Hui Huang

While Large Language Models (LLMs) have revolutionized artificial intelligence, fine-tuning LLMs is extraordinarily computationally expensive, preventing smaller businesses and research teams with limited GPU resources from engaging with…

Machine Learning · Computer Science 2025-08-26 Daniel Frees , Aditri Bhagirath , Moritz Bolling

Low Rank Adaptation (LoRA) has emerged as one of the most widely adopted methods for Parameter Efficient Fine-Tuning (PEFT) of Large Language Models (LLMs). LoRA reduces the number of trainable parameters and memory usage while achieving…

Computation and Language · Computer Science 2024-05-03 Justin Zhao , Timothy Wang , Wael Abid , Geoffrey Angus , Arnav Garg , Jeffery Kinnison , Alex Sherstinsky , Piero Molino , Travis Addair , Devvret Rishi

Natural Language Processing (NLP) has transformed the financial industry, enabling advancements in areas such as textual analysis, risk management, and forecasting. Large language models (LLMs) like BloombergGPT and FinMA have set new…

Computation and Language · Computer Science 2025-12-08 Jawad Ibn Ahad , Muhammad Rafsan Kabir , Robin Krambroeckers , Sifat Momen , Nabeel Mohammed , Shafin Rahman

Low-Rank Adaptation (LoRA) has emerged as one of the most widely used parameter-efficient fine-tuning (PEFT) methods for adapting large language models (LLMs) to downstream tasks. While highly effective in single-task settings, it struggles…

Computation and Language · Computer Science 2025-10-14 Bo Cheng , Xu Wang , Jinda Liu , Yi Chang , Yuan Wu

Named Entity Recognition (NER) is a fundamental Natural Language Processing (NLP) task to extract entities from unstructured data. The previous methods for NER were based on machine learning or deep learning. Recently, pre-training models…

Computation and Language · Computer Science 2020-02-21 Yu Wang , Yining Sun , Zuchang Ma , Lisheng Gao , Yang Xu , Ting Sun

Low-Rank Adaptation (LoRA) is one of the most widely used techniques for fine-tuning large language models (LLMs). By introducing a small number of trainable low-rank weight matrices, LoRA substantially reduces the number of parameters that…

Machine Learning · Computer Science 2025-07-15 Seokmin Ko

Large Language Models (LLMs) exhibit considerable promise in financial applications; however, prevailing models frequently demonstrate limitations when confronted with scenarios that necessitate sophisticated reasoning capabilities,…

Computation and Language · Computer Science 2025-07-29 Yanjun Zheng , Xiyang Du , Longfei Liao , Xiaoke Zhao , Zhaowen Zhou , Jingze Song , Bo Zhang , Jiawei Liu , Xiang Qi , Zhe Li , Zhiqiang Zhang , Wei Wang , Peng Zhang

Fine-tuning pre-trained language models has recently become a common practice in building NLP models for various tasks, especially few-shot tasks. We argue that under the few-shot setting, formulating fine-tuning closer to the pre-training…

Computation and Language · Computer Science 2022-11-01 Zihan Wang , Kewen Zhao , Zilong Wang , Jingbo Shang

Low-Rank Adaptation (LoRA) is a widely-used parameter-efficient finetuning method for large language models. LoRA saves memory by training only low rank perturbations to selected weight matrices. In this work, we compare the performance of…

Accurate skill extraction from job descriptions is crucial in the hiring process but remains challenging. Named Entity Recognition (NER) is a common approach used to address this issue. With the demonstrated success of large language models…

Computation and Language · Computer Science 2024-10-17 Amirhossein Herandi , Yitao Li , Zhanlin Liu , Ximin Hu , Xiao Cai

Both encoder-only models (e.g., BERT, RoBERTa) and large language models (LLMs, e.g., Llama3) have been widely used for text classification tasks. However, there is a lack of systematic studies comparing the performance of encoder-based…

Computation and Language · Computer Science 2025-05-13 Hang Zhao , Qile P. Chen , Yijing Barry Zhang , Gang Yang

An important paradigm of natural language processing consists of large-scale pre-training on general domain data and adaptation to particular tasks or domains. As we pre-train larger models, full fine-tuning, which retrains all model…

Computation and Language · Computer Science 2021-10-19 Edward J. Hu , Yelong Shen , Phillip Wallis , Zeyuan Allen-Zhu , Yuanzhi Li , Shean Wang , Lu Wang , Weizhu Chen

Large Language Models (LLMs) have shown impressive abilities in data annotation, opening the way for new approaches to solve classic NLP problems. In this paper, we show how to use LLMs to create NuNER, a compact language representation…

Computation and Language · Computer Science 2024-02-26 Sergei Bogdanov , Alexandre Constantin , Timothée Bernard , Benoit Crabbé , Etienne Bernard

The use of LLMs for natural language processing has become a popular trend in the past two years, driven by their formidable capacity for context comprehension and learning, which has inspired a wave of research from academics and industry…

Computation and Language · Computer Science 2024-04-09 Faren Yan , Peng Yu , Xin Chen

Named Entity Recognition(NER) is a task of recognizing entities at a token level in a sentence. This paper focuses on solving NER tasks in a multilingual setting for complex named entities. Our team, LLM-RM participated in the recently…

Computation and Language · Computer Science 2023-05-08 Rahul Mehta , Vasudeva Varma

Deploying natural language processing (NLP) models on mobile platforms requires models that can adapt across diverse applications while remaining efficient in memory and computation. We investigate pre-finetuning strategies to enhance the…

Computation and Language · Computer Science 2025-10-10 Junyi Zhu , Savas Ozkan , Andrea Maracani , Sinan Mutlu , Cho Jung Min , Mete Ozay