English
Related papers

Related papers: Rethinking Why Intermediate-Task Fine-Tuning Works

200 papers

Recent studies have shown that Large Language Models (LLMs) struggle to accurately retrieve information and maintain reasoning capabilities when processing long-context inputs. To address these limitations, we propose a finetuning approach…

Machine Learning · Computer Science 2024-10-15 Zheyang Xiong , Vasilis Papageorgiou , Kangwook Lee , Dimitris Papailiopoulos

We lack a systematic understanding of the effects of fine-tuning (via methods such as instruction-tuning or reinforcement learning from human feedback), particularly on tasks outside the narrow fine-tuning distribution. In a simplified…

Computation and Language · Computer Science 2024-04-16 Suhas Kotha , Jacob Mitchell Springer , Aditi Raghunathan

To improve the performance on a target task, researchers have fine-tuned language models with an intermediate task before the target task of interest. However, previous works have focused on the pre-trained language models and downstream…

Software Engineering · Computer Science 2024-10-07 Qihong Chen , Jiawei Li , Hyunjae Suh , Lianghao Jiang , Zheng Zhou , Jingze Chen , Jiri Gesi , Iftekhar Ahmed

Current large language models can perform reasonably well on complex tasks that require step-by-step reasoning with few-shot learning. Are these models applying reasoning skills they have learnt during pre-training and reason outside of…

Computation and Language · Computer Science 2023-10-02 Ping Yu , Tianlu Wang , Olga Golovneva , Badr AlKhamissi , Siddharth Verma , Zhijing Jin , Gargi Ghosh , Mona Diab , Asli Celikyilmaz

Recent advancements highlight the success of instruction tuning with large language models (LLMs) utilizing Chain-of-Thought (CoT) data for mathematical reasoning tasks. Despite the fine-tuned LLMs, challenges persist, such as incorrect,…

Computation and Language · Computer Science 2024-03-28 Yongwei Zhou , Tiejun Zhao

The application of large language models (LLMs) in domain-specific contexts, including finance, has expanded rapidly. Domain-specific LLMs are typically evaluated based on their performance in various downstream tasks relevant to the…

Artificial Intelligence · Computer Science 2024-12-06 Meni Brief , Oded Ovadia , Gil Shenderovitz , Noga Ben Yoash , Rachel Lemberg , Eitam Sheetrit

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuning again on the target task---often improves model performance substantially on language understanding tasks in monolingual English…

Computation and Language · Computer Science 2020-10-02 Jason Phang , Iacer Calixto , Phu Mon Htut , Yada Pruksachatkun , Haokun Liu , Clara Vania , Katharina Kann , Samuel R. Bowman

Although supervised finetuning (SFT) has emerged as an essential technique to align large language models with humans, it is considered superficial, with style learning being its nature. At the same time, recent works indicate the…

Computation and Language · Computer Science 2024-02-12 Ming Shen

Training a task-specific small reasoning model is challenging when direct human supervision or high-quality labels are scarce. However, LLMs with reasoning capabilities produce abundant intermediate reasoning traces that can be…

Computation and Language · Computer Science 2025-09-19 Sumanta Bhattacharyya , Sara Riazi , Pedram Rooshenas

Large Language Models (LLMs) with reasoning capabilities have achieved state-of-the-art performance on a wide range of tasks. Despite its empirical success, the tasks and model scales at which reasoning becomes effective, as well as its…

Computation and Language · Computer Science 2025-09-29 Nicolas Boizard , Hippolyte Gisserot-Boukhlef , Kevin El-Haddad , Céline Hudelot , Pierre Colombo

In this paper, we explore the impact of augmenting pre-trained Encoder-Decoder models, specifically T5, with linguistic knowledge for the prediction of a target task. In particular, we investigate whether fine-tuning a T5 model on an…

Computation and Language · Computer Science 2024-02-28 Alessio Miaschi , Felice Dell'Orletta , Giulia Venturi

Prompt tuning has been an extremely effective tool to adapt a pre-trained model to downstream tasks. However, standard prompt-based methods mainly consider the case of sufficient data of downstream tasks. It is still unclear whether the…

Computation and Language · Computer Science 2022-07-19 Ping Yu , Wei Wang , Chunyuan Li , Ruiyi Zhang , Zhanpeng Jin , Changyou Chen

Loading models pre-trained on the large-scale corpus in the general domain and fine-tuning them on specific downstream tasks is gradually becoming a paradigm in Natural Language Processing. Previous investigations prove that introducing a…

Computation and Language · Computer Science 2021-09-15 Yao Qiu , Jinchao Zhang , Jie Zhou

In recent times, BERT-based models have been extremely successful in solving a variety of natural language processing (NLP) tasks such as reading comprehension, natural language inference, sentiment analysis, etc. All BERT-based…

Computation and Language · Computer Science 2023-04-06 Sharath Nittur Sridhar , Anthony Sarah

Language models (LMs) trained on vast quantities of unlabelled data have greatly advanced the field of natural language processing (NLP). In this study, we re-visit the widely accepted notion in NLP that continued pre-training LMs on…

Computation and Language · Computer Science 2023-10-09 Zhengxiang Shi , Aldo Lipani

Fine-tuning pretrained language models (PLMs) on downstream tasks has become common practice in natural language processing. However, most of the PLMs are vulnerable, e.g., they are brittle under adversarial attacks or imbalanced data,…

Computation and Language · Computer Science 2022-05-03 Shoujie Tong , Qingxiu Dong , Damai Dai , Yifan song , Tianyu Liu , Baobao Chang , Zhifang Sui

Intelligent agents should have the ability to leverage knowledge from previously learned tasks in order to learn new ones quickly and efficiently. Meta-learning approaches have emerged as a popular solution to achieve this. However,…

Machine Learning · Computer Science 2023-02-17 Zhao Mandi , Pieter Abbeel , Stephen James

Large reasoning models (LRMs) have led to new possibilities in terms of problem-solving, through the devising of a natural language thought process prior to answering a query. While their capabilities are well known across mathematics and…

Computation and Language · Computer Science 2025-10-15 Armel Zebaze , Rachel Bawden , Benoît Sagot

Reinforcement Fine-Tuning (RFT) is proved to be greatly valuable for enhancing the reasoning ability of LLMs. Researchers have been starting to apply RFT to MLLMs, hoping it will also enhance the capabilities of visual understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Xiaxu Chen , Wei Li , Chunxu Liu , Chi Xie , Xiaoyan Hu , Chengqian Ma , Feng Zhu , Rui Zhao

Pre-training a language model and then fine-tuning it for downstream tasks has demonstrated state-of-the-art results for various NLP tasks. Pre-training is usually independent of the downstream task, and previous works have shown that this…

Computation and Language · Computer Science 2022-11-28 Tanish Lad , Himanshu Maheshwari , Shreyas Kottukkal , Radhika Mamidi