English
Related papers

Related papers: Multi-Stage Influence Function

200 papers

Foundation language models learn from their finetuning input context in different ways. In this paper, we reformulate inputs during finetuning for challenging translation tasks, leveraging model strengths from pretraining in novel ways to…

Computation and Language · Computer Science 2026-01-05 Brian Yu , Hansen Lillemark , Kurt Keutzer

Language models pretrained on text from a wide variety of sources form the foundation of today's NLP. In light of the success of these broad-coverage models, we investigate whether it is still helpful to tailor a pretrained model to the…

Computation and Language · Computer Science 2020-05-07 Suchin Gururangan , Ana Marasović , Swabha Swayamdipta , Kyle Lo , Iz Beltagy , Doug Downey , Noah A. Smith

Efficient finetuning of pretrained language transformers is becoming increasingly prevalent for solving natural language processing tasks. While effective, it can still require a large number of tunable parameters. This can be a drawback…

Computation and Language · Computer Science 2023-05-31 Umang Gupta , Aram Galstyan , Greg Ver Steeg

Prompt tuning has become a new paradigm for model tuning and it has demonstrated success in natural language pretraining and even vision pretraining. In this work, we explore the transfer of prompt tuning to multimodal pretraining, with a…

Computation and Language · Computer Science 2022-08-05 Hao Yang , Junyang Lin , An Yang , Peng Wang , Chang Zhou , Hongxia Yang

Foundation models have achieved great advances in multi-task learning with a unified interface of unimodal and multimodal tasks. However, the potential of such multi-task learners has not been exploited during transfer learning. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Chengyue Wu , Teng Wang , Yixiao Ge , Zeyu Lu , Ruisong Zhou , Ying Shan , Ping Luo

Existing research has shown that a multilingual pre-trained language model fine-tuned with one (source) language also performs well on downstream tasks for non-source languages, even though no fine-tuning is done on these languages.…

Computation and Language · Computer Science 2023-05-22 Yiduo Guo , Yaobo Liang , Dongyan Zhao , Bing Liu , Duan Nan

A recent family of techniques, dubbed lightweight fine-tuning methods, facilitates parameter-efficient transfer learning by updating only a small set of additional parameters while keeping the parameters of the pretrained language model…

Computation and Language · Computer Science 2022-12-09 Mozhdeh Gheini , Xuezhe Ma , Jonathan May

Intelligent agents should have the ability to leverage knowledge from previously learned tasks in order to learn new ones quickly and efficiently. Meta-learning approaches have emerged as a popular solution to achieve this. However,…

Machine Learning · Computer Science 2023-02-17 Zhao Mandi , Pieter Abbeel , Stephen James

We present the first use of influence functions for deep learning-based wireless receivers. Applied to DeepRx, a fully convolutional receiver, influence analysis reveals which training samples drive bit predictions, enabling targeted…

Machine Learning · Computer Science 2026-01-22 Marko Tuononen , Heikki Penttinen , Ville Hautamäki

Language model pre-training has proven to be useful in many language understanding tasks. In this paper, we investigate whether it is still helpful to add the self-training method in the pre-training step and the fine-tuning step. Towards…

Computation and Language · Computer Science 2023-02-17 Tong Guo

Large, pre-trained representation models trained using self-supervised learning have gained popularity in various fields of machine learning because they are able to extract high-quality salient features from input data. As such, they have…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-16 Hejung Yang , Hong-Goo Kang

Prompt learning has emerged as an efficient alternative for fine-tuning foundational models, such as CLIP, for various downstream tasks. However, there is no work that provides a comprehensive explanation for the working mechanism of the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Shuailei Ma , Chen-Wei Xie , Ying Wei , Siyang Sun , Jiaqi Fan , Xiaoyi Bao , Yuxin Guo , Yun Zheng

Aligned representations across languages is a desired property in multilingual large language models (mLLMs), as alignment can improve performance in cross-lingual tasks. Typically alignment requires fine-tuning a model, which is…

Computation and Language · Computer Science 2025-07-22 Anirudh Sundar , Sinead Williamson , Katherine Metcalf , Barry-John Theobald , Skyler Seto , Masha Fedzechkina

In recent years, domains such as natural language processing and image recognition have popularized the paradigm of using large datasets to pretrain representations that can be effectively transferred to downstream tasks. In this work we…

Machine Learning · Computer Science 2023-10-26 David Brandfonbrener , Ofir Nachum , Joan Bruna

In this work, we propose a multi-stage training strategy for the development of deep learning algorithms applied to problems with multiscale features. Each stage of the pro-posed strategy shares an (almost) identical network structure and…

Numerical Analysis · Mathematics 2020-09-25 Eric Chung , Wing Tat Leung , Sai-Mang Pun , Zecheng Zhang

With the ever-increasing number of pretrained models, machine learning practitioners are continuously faced with which pretrained model to use, and how to finetune it for a new dataset. In this paper, we propose a methodology that jointly…

Machine Learning · Computer Science 2024-02-26 Sebastian Pineda Arango , Fabio Ferreira , Arlind Kadra , Frank Hutter , Josif Grabocka

Instruction tuning of language models has demonstrated the ability to enhance model generalization to unseen tasks via in-context learning using a few examples. However, typical supervised learning still requires a plethora of downstream…

Computation and Language · Computer Science 2023-06-12 Himanshu Gupta , Saurabh Arjun Sawant , Swaroop Mishra , Mutsumi Nakamura , Arindam Mitra , Santosh Mashetty , Chitta Baral

A common approach to transfer learning under distribution shift is to fine-tune the last few layers of a pre-trained model, preserving learned features while also adapting to the new task. This paper shows that in such settings, selectively…

Machine Learning · Computer Science 2023-06-07 Yoonho Lee , Annie S. Chen , Fahim Tajwar , Ananya Kumar , Huaxiu Yao , Percy Liang , Chelsea Finn

Pre-training has marked numerous state of the arts in high-level computer vision, while few attempts have ever been made to investigate how pre-training acts in image processing systems. In this paper, we tailor transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Wenbo Li , Xin Lu , Shengju Qian , Jiangbo Lu , Xiangyu Zhang , Jiaya Jia

As a dominant paradigm, fine-tuning a pre-trained model on the target data is widely used in many deep learning applications, especially for small data sets. However, recent studies have empirically shown that training from scratch has the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Ziquan Liu , Yi Xu , Yuanhong Xu , Qi Qian , Hao Li , Xiangyang Ji , Antoni Chan , Rong Jin