English
Related papers

Related papers: How fine can fine-tuning be? Learning efficient la…

200 papers

The extensive memory footprint of language model (LM) fine-tuning poses a challenge for both researchers and practitioners. LMs use an embedding matrix to represent extensive vocabularies, forming a substantial proportion of the model…

Computation and Language · Computer Science 2025-03-26 Miles Williams , Nikolaos Aletras

A common way to use large pre-trained language models for downstream tasks is to fine tune them using additional layers. This may not work well if downstream domain is a specialized domain whereas the large language model has been…

Computation and Language · Computer Science 2023-05-31 Vanessa Liao , Syed Shariyar Murtaza , Yifan Nie , Jimmy Lin

Over the past few decades, Artificial Intelligence(AI) has progressed from the initial machine learning stage to the deep learning stage, and now to the stage of foundational models. Foundational models have the characteristics of…

Computation and Language · Computer Science 2024-11-28 Lewen Yang , Xuanyu Zhou , Juao Fan , Xinyi Xie , Shengxin Zhu

With the continuous growth in the number of parameters of transformer-based pretrained language models (PLMs), particularly the emergence of large language models (LLMs) with billions of parameters, many natural language processing (NLP)…

Computation and Language · Computer Science 2023-12-20 Lingling Xu , Haoran Xie , Si-Zhao Joe Qin , Xiaohui Tao , Fu Lee Wang

Recently, pre-trained Transformer based language models such as BERT and GPT, have shown great improvement in many Natural Language Processing (NLP) tasks. However, these models contain a large amount of parameters. The emergence of even…

Computation and Language · Computer Science 2021-12-20 Ofir Zafrir , Guy Boudoukh , Peter Izsak , Moshe Wasserblat

Transformer-based language models are applied to a wide range of applications in natural language processing. However, they are inefficient and difficult to deploy. In recent years, many compression algorithms have been proposed to increase…

Computation and Language · Computer Science 2021-11-11 Ofir Zafrir , Ariel Larey , Guy Boudoukh , Haihao Shen , Moshe Wasserblat

Pretrained language models are promising particularly for low-resource languages as they only require unlabelled data. However, training existing models requires huge amounts of compute, while pretrained cross-lingual models often…

Computation and Language · Computer Science 2020-06-05 Julian Martin Eisenschlos , Sebastian Ruder , Piotr Czapla , Marcin Kardas , Sylvain Gugger , Jeremy Howard

Pre-trained language models can be fine-tuned to solve diverse NLP tasks, including in few-shot settings. Thus fine-tuning allows the model to quickly pick up task-specific ``skills,'' but there has been limited study of where these…

Computation and Language · Computer Science 2023-07-04 Abhishek Panigrahi , Nikunj Saunshi , Haoyu Zhao , Sanjeev Arora

Several studies have investigated the reasons behind the effectiveness of fine-tuning, usually through the lens of probing. However, these studies often neglect the role of the size of the dataset on which the model is fine-tuned. In this…

Computation and Language · Computer Science 2022-03-21 Houman Mehrafarin , Sara Rajaee , Mohammad Taher Pilehvar

Current methods for few-shot fine-tuning of pretrained masked language models (PLMs) require carefully engineered prompts and verbalizers for each new task to convert examples into a cloze-format that the PLM can score. In this work, we…

Computation and Language · Computer Science 2022-04-27 Rabeeh Karimi Mahabadi , Luke Zettlemoyer , James Henderson , Marzieh Saeidi , Lambert Mathias , Veselin Stoyanov , Majid Yazdani

Fine-tuning pre-trained language models like BERT has become an effective way in NLP and yields state-of-the-art results on many downstream tasks. Recent studies on adapting BERT to new tasks mainly focus on modifying the model structure,…

Computation and Language · Computer Science 2020-02-25 Yige Xu , Xipeng Qiu , Ligao Zhou , Xuanjing Huang

Large Transformer models achieved the state-of-the-art status for Natural Language Understanding tasks and are increasingly becoming the baseline model architecture for modeling source code. Transformers are usually pre-trained on large…

Software Engineering · Computer Science 2022-09-21 Andrei Zlotchevski , Dawn Drain , Alexey Svyatkovskiy , Colin Clement , Neel Sundaresan , Michele Tufano

Large language models encode impressively broad world knowledge in their parameters. However, the knowledge in static language models falls out of date, limiting the model's effective "shelf life." While online fine-tuning can reduce this…

Computation and Language · Computer Science 2023-10-24 Nathan Hu , Eric Mitchell , Christopher D. Manning , Chelsea Finn

Large Language Models have become the core architecture upon which most modern natural language processing (NLP) systems build. These models can consistently deliver impressive accuracy and robustness across tasks and domains, but their…

Computation and Language · Computer Science 2023-04-07 Daniel Campos , Alexandre Marques , Tuan Nguyen , Mark Kurtz , ChengXiang Zhai

Pre-trained models have brought significant improvements to many NLP tasks and have been extensively analyzed. But little is known about the effect of fine-tuning on specific tasks. Intuitively, people may agree that a pre-trained model…

Computation and Language · Computer Science 2020-06-03 Jie Cai , Zhengzhou Zhu , Ping Nie , Qian Liu

Increasing model size when pretraining natural language representations often results in improved performance on downstream tasks. However, at some point further model increases become harder due to GPU/TPU memory limitations and longer…

Computation and Language · Computer Science 2020-02-11 Zhenzhong Lan , Mingda Chen , Sebastian Goodman , Kevin Gimpel , Piyush Sharma , Radu Soricut

Recently, we have observed that Large Multi-modal Models (LMMs) are revolutionizing the way machines interact with the world, unlocking new possibilities across various multi-modal applications. To adapt LMMs for downstream tasks,…

Computation and Language · Computer Science 2024-11-04 Donghoon Kim , Gusang Lee , Kyuhong Shim , Byonghyo Shim

Seeking legal advice is often expensive. Recent advancements in machine learning for solving complex problems can be leveraged to help make legal services more accessible to the public. However, real-life applications encounter significant…

Computation and Language · Computer Science 2022-11-07 Jonathan Li , Rohan Bhambhoria , Xiaodan Zhu

While pre-training and fine-tuning, e.g., BERT~\citep{devlin2018bert}, GPT-2~\citep{radford2019language}, have achieved great success in language understanding and generation tasks, the pre-trained models are usually too big for online…

Computation and Language · Computer Science 2020-04-28 Kaitao Song , Hao Sun , Xu Tan , Tao Qin , Jianfeng Lu , Hongzhi Liu , Tie-Yan Liu

Large language models (LLMs), or foundation models (FMs), are pretrained transformers that coherently complete sentences auto-regressively. In this paper, we show that LLMs can control simplified space systems after some additional…

Machine Learning · Computer Science 2025-01-29 Enrico M. Zucchelli , Di Wu , Julia Briden , Christian Hofmann , Victor Rodriguez-Fernandez , Richard Linares