English
Related papers

Related papers: Transferring Knowledge from Large Foundation Model…

200 papers

Multi-Task Learning (MTL) networks have emerged as a promising method for transferring learned knowledge across different tasks. However, MTL must deal with challenges such as: overfitting to low resource tasks, catastrophic forgetting, and…

Machine Learning · Computer Science 2022-04-22 Jonathan Pilault , Amine Elhattami , Christopher Pal

Transfer Learning enables Convolutional Neural Networks (CNN) to acquire knowledge from a source domain and transfer it to a target domain, where collecting large-scale annotated examples is time-consuming and expensive. Conventionally,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 S. H. Shabbeer Basha , Debapriya Tula , Sravan Kumar Vinakota , Shiv Ram Dubey

Continual post-training (CPT) is a popular and effective technique for adapting foundation models like multimodal large language models to specific and ever-evolving downstream tasks. While existing research has primarily concentrated on…

Machine Learning · Computer Science 2026-01-22 Song Lai , Haohan Zhao , Rong Feng , Changyi Ma , Wenzhuo Liu , Hongbo Zhao , Xi Lin , Dong Yi , Qingfu Zhang , Hongbin Liu , Gaofeng Meng , Fei Zhu

Recent results show that features of adversarially trained networks for classification, in addition to being robust, enable desirable properties such as invertibility. The latter property may seem counter-intuitive as it is widely accepted…

Machine Learning · Computer Science 2020-12-17 Matteo Terzi , Alessandro Achille , Marco Maggipinto , Gian Antonio Susto

Transfer learning can be applied in deep reinforcement learning to accelerate the training of a policy in a target task by transferring knowledge from a policy learned in a related source task. This is commonly achieved by copying…

Machine Learning · Computer Science 2023-06-22 Joseph Campbell , Yue Guo , Fiona Xie , Simon Stepputtis , Katia Sycara

Although CNNs have gained the ability to transfer learned knowledge from source task to target task by virtue of large annotated datasets but consume huge processing time to fine-tune without GPU. In this paper, we propose a new…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Tasfia Shermin , Manzur Murshed , Guojun Lu , Shyh Wei Teng

This paper presents an automatic network adaptation method that finds a ConvNet structure well-suited to a given target task, e.g., image classification, for efficiency as well as accuracy in transfer learning. We call the concept…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Yang Zhong , Vladimir Li , Ryuzo Okada , Atsuto Maki

A growing number of state-of-the-art transfer learning methods employ language models pretrained on large generic corpora. In this paper we present a conceptually simple and effective transfer learning approach that addresses the problem of…

Computation and Language · Computer Science 2019-06-03 Alexandra Chronopoulou , Christos Baziotis , Alexandros Potamianos

Foundation models encode rich representations that can be adapted to downstream tasks by fine-tuning. However, fine-tuning a model on one data distribution often degrades performance under distribution shifts. Current approaches to robust…

Machine Learning · Computer Science 2024-03-15 Caroline Choi , Yoonho Lee , Annie Chen , Allan Zhou , Aditi Raghunathan , Chelsea Finn

Transferring knowledge by fine-tuning large-scale pre-trained networks has become a standard paradigm for downstream tasks, yet the knowledge of a pre-trained model is tightly coupled with monolithic architecture, which restricts flexible…

Machine Learning · Computer Science 2026-05-26 Jianlu Shen , Fu Feng , Yucheng Xie , Jiaqi Lv , Xin Geng

Foundation models encompass an extensive knowledge base and offer remarkable transferability. However, this knowledge becomes outdated or insufficient over time. The challenge lies in continuously updating foundation models to accommodate…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Wenxuan Zhang , Paul Janson , Rahaf Aljundi , Mohamed Elhoseiny

Transfer learning with models pretrained on ImageNet has become a standard practice in computer vision. Transfer learning refers to fine-tuning pretrained weights of a neural network on a downstream task, typically unrelated to ImageNet.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Xander Coetzer , Arné Schreuder , Anna Sergeevna Bosman

Transfer learning is a classic paradigm by which models pretrained on large "upstream" datasets are adapted to yield good results on "downstream" specialized datasets. Generally, more accurate models on the "upstream" dataset tend to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Eugenia Iofinova , Alexandra Peste , Mark Kurtz , Dan Alistarh

Few-shot learning allows machines to classify novel classes using only a few labeled samples. Recently, few-shot segmentation aiming at semantic segmentation on low sample data has also seen great interest. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Jun Seo , Young-Hyun Park , Sung Whan Yoon , Jaekyun Moon

Efficient fine-tuning of pre-trained Text-to-Image (T2I) models involves adjusting the model to suit a particular task or dataset while minimizing computational resources and limiting the number of trainable parameters. However, it often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Komal Kumar , Rao Muhammad Anwer , Fahad Shahbaz Khan , Salman Khan , Ivan Laptev , Hisham Cholakkal

While recent advances in machine learning have equipped Weather Foundation Models (WFMs) with substantial generalization capabilities across diverse downstream tasks, the escalating computational requirements associated with their expanding…

Adapting large pre-trained models to unseen tasks under tight data and compute budgets remains challenging. Meta-learning approaches explicitly learn good initializations, but they require an additional meta-training phase over many tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Junghwan Park , Woojin Cho , Junhyuk Heo , Darongsae Kwon , Kookjin Lee

This paper introduces Generalized Attention Flow (GAF), a novel feature attribution method for Transformer-based models to address the limitations of current approaches. By extending Attention Flow and replacing attention weights with the…

Machine Learning · Computer Science 2025-02-25 Behrooz Azarkhalili , Maxwell Libbrecht

Fine-tuning large pre-trained language models on downstream tasks has become the de-facto learning paradigm in NLP. However, conventional approaches fine-tune all the parameters of the pre-trained model, which becomes prohibitive as the…

Computation and Language · Computer Science 2022-02-03 Junxian He , Chunting Zhou , Xuezhe Ma , Taylor Berg-Kirkpatrick , Graham Neubig

Meta-Learning is a subarea of Machine Learning that aims to take advantage of prior knowledge to learn faster and with fewer data [1]. There are different scenarios where meta-learning can be applied, and one of the most common is algorithm…

Machine Learning · Computer Science 2019-10-17 Gean Trindade Pereira , Moisés dos Santos , Edesio Alcobaça , Rafael Mantovani , André Carvalho