English
Related papers

Related papers: A Flexible Selection Scheme for Minimum-Effort Tra…

200 papers

Transfer learning is beneficial by allowing the expressive features of models pretrained on large-scale datasets to be finetuned for the target task of smaller, more domain-specific datasets. However, there is a concern that these…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Angelina Wang , Olga Russakovsky

Large language models may encounter factual knowledge during pre-training yet fail to reliably use that knowledge after fine-tuning. Despite growing empirical evidence that MLP layers store factual associations and fine-tuning affects…

Machine Learning · Computer Science 2026-05-19 Ruichen Xu , Kexin Chen

Pre-trained language models can be fine-tuned to solve diverse NLP tasks, including in few-shot settings. Thus fine-tuning allows the model to quickly pick up task-specific ``skills,'' but there has been limited study of where these…

Computation and Language · Computer Science 2023-07-04 Abhishek Panigrahi , Nikunj Saunshi , Haoyu Zhao , Sanjeev Arora

A pretrain-finetune strategy is widely used to reduce the overfitting that can occur when data is insufficient for CNN training. First few layers of a CNN pretrained on a large-scale RGB dataset are capable of acquiring general image…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Hyungtae Lee , Sungmin Eum , Heesung Kwon

Due to the limited availability of data, existing few-shot learning methods trained from scratch fail to achieve satisfactory performance. In contrast, large-scale pre-trained models such as CLIP demonstrate remarkable few-shot and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Kun Song , Huimin Ma , Bochao Zou , Huishuai Zhang , Weiran Huang

It is impossible today to pretend that the practice of machine learning is always compatible with the idea that training and testing data follow the same distribution. Several authors have recently used ensemble techniques to show how…

Machine Learning · Computer Science 2025-03-03 Jianyu Zhang , Léon Bottou

Convolutional Neural Networks (CNNs) are a standard approach for visual recognition due to their capacity to learn hierarchical representations from raw pixels. In practice, practitioners often choose among (i) training a compact custom CNN…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Annoor Sharara Akhand

We study the problem of fine-tuning a language model (LM) for a target task by optimally using the information from $n$ auxiliary tasks. This problem has broad applications in NLP, such as targeted instruction tuning and data selection in…

Computation and Language · Computer Science 2025-06-03 Dongyue Li , Ziniu Zhang , Lu Wang , Hongyang R. Zhang

Transformers that are pre-trained on multilingual corpora, such as, mBERT and XLM-RoBERTa, have achieved impressive cross-lingual transfer capabilities. In the zero-shot transfer setting, only English training data is used, and the…

Computation and Language · Computer Science 2021-09-13 Yang Chen , Alan Ritter

Few-shot fine-tuning and in-context learning are two alternative strategies for task adaptation of pre-trained language models. Recently, in-context learning has gained popularity over fine-tuning due to its simplicity and improved…

Computation and Language · Computer Science 2023-05-31 Marius Mosbach , Tiago Pimentel , Shauli Ravfogel , Dietrich Klakow , Yanai Elazar

The "pre-training then fine-tuning (FT)" paradigm is widely adopted to boost the model performance of deep learning-based methods for medical volumetric segmentation. However, conventional full FT incurs high computational and memory costs.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Jiachen Shen , Wenxuan Wang , Chen Chen , Jianbo Jiao , Jing Liu , Yan Zhang , Shanshan Song , Jiangyun Li

Large pre-trained vision-language (VL) models have shown significant promise in adapting to various downstream tasks. However, fine-tuning the entire network is challenging due to the massive number of model parameters. To address this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jingchen Sun , Jiayu Qin , Zihao Lin , Changyou Chen

One of the great promises of robot learning systems is that they will be able to learn from their mistakes and continuously adapt to ever-changing environments. Despite this potential, most of the robot learning systems today are deployed…

Machine Learning · Computer Science 2020-08-03 Ryan Julian , Benjamin Swanson , Gaurav S. Sukhatme , Sergey Levine , Chelsea Finn , Karol Hausman

Morphology-aware policy learning is a means of enhancing policy sample efficiency by aggregating data from multiple agents. These types of policies have previously been shown to help generalize over dynamic, kinematic, and limb…

As large-scale text-to-image generation models have made remarkable progress in the field of text-to-image generation, many fine-tuning methods have been proposed. However, these models often struggle with novel objects, especially with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Jianxiang Lu , Cong Xie , Hui Guo

Fine-tuning is becoming widely used for leveraging the power of pre-trained foundation models in new downstream tasks. While there are many successes of fine-tuning on various tasks, recent studies have observed challenges in the…

Machine Learning · Computer Science 2024-06-21 Yuji Roh , Qingyun Liu , Huan Gui , Zhe Yuan , Yujin Tang , Steven Euijong Whang , Liang Liu , Shuchao Bi , Lichan Hong , Ed H. Chi , Zhe Zhao

Although massive pre-trained vision-language models like CLIP show impressive generalization capabilities for many tasks, still it often remains necessary to fine-tune them for improved performance on specific datasets. When doing so, it is…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Moritz Ibing , Isaak Lim , Leif Kobbelt

Due to the computational complexity of evaluating interatomic forces from first principles, the creation of interatomic machine learning force fields has become a highly active field of research. However, the generation of training datasets…

Machine Learning · Computer Science 2025-07-21 Tim Rensmeyer , Denis Kramer , Oliver Niggemann

In social media networks a small number of highly influential users can drive large scale changes in discourse across multiple communities. Small shifts in the behavior of these users are often sufficient to propagate widely throughout the…

Machine Learning · Computer Science 2025-12-16 Shaif Chowdhury , Soham Biren Katlariwala , Devleena Kashyap

State-of-the-art parameter-efficient fine-tuning methods rely on introducing adapter modules between the layers of a pretrained language model. However, such modules are trained separately for each task and thus do not enable sharing…

Computation and Language · Computer Science 2021-06-09 Rabeeh Karimi Mahabadi , Sebastian Ruder , Mostafa Dehghani , James Henderson