中文
相关论文

相关论文: Adaptive Transfer Learning: a simple but effective…

200 篇论文

Transfer learning (TL) enables the transfer of knowledge gained in learning to perform one task (source) to a related but different task (target), hence addressing the expense of data acquisition and labeling, potential computational power…

机器学习 · 计算机科学 2022-12-20 Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis

Deep neural networks can yield good performance on various tasks but often require large amounts of data to train them. Meta-learning received considerable attention as one approach to improve the generalization of these networks from a…

机器学习 · 计算机科学 2023-10-11 Mike Huisman , Aske Plaat , Jan N. van Rijn

We study the question: How can we select the right data for fine-tuning to a specific task? We call this data selection problem active fine-tuning and show that it is an instance of transductive active learning, a novel generalization of…

机器学习 · 计算机科学 2024-06-24 Jonas Hübotter , Bhavya Sukhija , Lenart Treven , Yarden As , Andreas Krause

Neural Transfer Learning (TL) is becoming ubiquitous in Natural Language Processing (NLP), thanks to its high performance on many tasks, especially in low-resourced scenarios. Notably, TL is widely used for neural domain adaptation to…

计算与语言 · 计算机科学 2021-06-10 Sara Meftah , Nasredine Semmar , Youssef Tamaazousti , Hassane Essafi , Fatiha Sadat

Transfer learning eases the burden of training a well-performed model from scratch, especially when training data is scarce and computation power is limited. In deep learning, a typical strategy for transfer learning is to freeze the early…

机器学习 · 计算机科学 2021-06-15 Dian Chen , Hongxin Hu , Qian Wang , Yinli Li , Cong Wang , Chao Shen , Qi Li

Parameter fine tuning is a transfer learning approach whereby learned parameters from pre-trained source network are transferred to the target network followed by fine-tuning. Prior research has shown that this approach is capable of…

计算机视觉与模式识别 · 计算机科学 2019-09-20 Tasfia Shermin , Shyh Wei Teng , Manzur Murshed , Guojun Lu , Ferdous Sohel , Manoranjan Paul

Transfer learning allows us to train deep architectures requiring a large number of learned parameters, even if the amount of available data is limited, by leveraging existing models previously trained for another task. Here we explore the…

软件工程 · 计算机科学 2020-03-04 Natalie Best , Jordan Ott , Erik Linstead

There is an increasing number of pre-trained deep neural network models. However, it is still unclear how to effectively use these models for a new task. Transfer learning, which aims to transfer knowledge from source tasks to a target…

计算机视觉与模式识别 · 计算机科学 2019-12-10 Yunhui Guo , Yandong Li , Liqiang Wang , Tajana Rosing

Transfer Learning (TL) offers the potential to accelerate learning by transferring knowledge across tasks. However, it faces critical challenges such as negative transfer, domain adaptation and inefficiency in selecting solid source…

机器学习 · 计算机科学 2025-07-29 Alessandro Capurso , Elia Piccoli , Davide Bacciu

Machine learning (ML) accelerates the exploration of material properties and their links to the structure of the underlying molecules. In previous work [J. Shi, M. J. Quevillon, P. H. A. Valen\c{c}a, and J. K. Whitmer, \textit{ACS Appl.…

软凝聚态物质 · 物理学 2023-01-06 Jiale Shi , Fahed Albreiki , Yamil J. Colón , Samanvaya Srivastava , Jonathan K. Whitmer

Transfer learning entails taking an artificial neural network (ANN) that is trained on a source dataset and adapting it to a new target dataset. While this has been shown to be quite powerful, its use has generally been restricted by…

神经与进化计算 · 计算机科学 2020-06-05 AbdElRahman ElSaid , Joshua Karns , Alexander Ororbia , Daniel Krutz , Zimeng Lyu , Travis Desell

The proliferation of sensors brings an immense volume of spatio-temporal (ST) data in many domains, including monitoring, diagnostics, and prognostics applications. Data curation is a time-consuming process for a large volume of data,…

In this paper, we present a new approach to Transfer Learning (TL) in Reinforcement Learning (RL) for cross-domain tasks. Many of the available techniques approach the transfer architecture as a method of speeding up the target task…

人工智能 · 计算机科学 2018-01-23 Girish Joshi , Girish Chowdhary

Multi-task learning (MTL) has been successfully used in many real-world applications, which aims to simultaneously solve multiple tasks with a single model. The general idea of multi-task learning is designing kinds of global parameter…

机器学习 · 计算机科学 2023-01-24 Xuewen Tao , Mingming Ha , Xiaobo Guo , Qiongxu Ma , Hongwei Cheng , Wenfang Lin

Transfer Learning (TL) aims to transfer knowledge acquired in one problem, the source problem, onto another problem, the target problem, dispensing with the bottom-up construction of the target model. Due to its relevance, TL has gained…

Transfer learning is widely used for training deep neural networks (DNN) for building a powerful representation. Even after the pre-trained model is adapted for the target task, the representation performance of the feature extractor is…

机器学习 · 计算机科学 2023-08-22 Seunghee Koh , Hyounguk Shon , Janghyeon Lee , Hyeong Gwon Hong , Junmo Kim

Transfer learning (TL) is used to extrapolate the physics information encoded in a Generative Adversarial Network (GAN) trained on synthetic neutrino-carbon inclusive scattering data to related processes such as neutrino-argon and…

Multi-task learning is to improve the performance of the model by transferring and exploiting common knowledge among tasks. Existing MTL works mainly focus on the scenario where label sets among multiple tasks (MTs) are usually the same,…

机器学习 · 计算机科学 2022-01-10 Quan Feng , Songcan Chen

Deep transfer learning (DTL) has formed a long-term quest toward enabling deep neural networks (DNNs) to reuse historical experiences as efficiently as humans. This ability is named knowledge transferability. A commonly used paradigm for…

计算机视觉与模式识别 · 计算机科学 2022-12-02 Yixiong Chen , Jingxian Li , Chris Ding , Li Liu

Multi-Task Learning (MTL) networks have emerged as a promising method for transferring learned knowledge across different tasks. However, MTL must deal with challenges such as: overfitting to low resource tasks, catastrophic forgetting, and…

机器学习 · 计算机科学 2022-04-22 Jonathan Pilault , Amine Elhattami , Christopher Pal