English
Related papers

Related papers: Transfer Learning for Performance Modeling of Conf…

200 papers

Determining onflow parameters is crucial from the perspectives of wind tunnel testing and regular flight and wind turbine operations. These parameters have traditionally been predicted via direct measurements which might lead to challenges…

Machine Learning · Computer Science 2025-06-19 Emre Yilmaz , Philipp Bekemeyer

The ability to adapt to changes in environmental contingencies is an important challenge in reinforcement learning. Indeed, transferring previously acquired knowledge to environments with unseen structural properties can greatly enhance the…

Machine Learning · Computer Science 2021-10-28 Ayman Boustati , Hana Chockler , Daniel C. McNamee

Transfer learning is critical for efficient information transfer across multiple related learning problems. A simple, yet effective transfer learning approach utilizes deep neural networks trained on a large-scale task for feature…

Sound · Computer Science 2021-06-23 Anurag Kumar , Yun Wang , Vamsi Krishna Ithapu , Christian Fuegen

Exploration and adaptation to new tasks in a transfer learning setup is a central challenge in reinforcement learning. In this work, we build on the idea of modeling a distribution over policies in a Bayesian deep reinforcement learning…

Machine Learning · Computer Science 2019-06-11 Disha Shrivastava , Eeshan Gunesh Dhekane , Riashat Islam

This paper studies transfer learning for estimating the mean of random functions based on discretely sampled data, where, in addition to observations from the target distribution, auxiliary samples from similar but distinct source…

Statistics Theory · Mathematics 2024-03-29 T. Tony Cai , Dongwoo Kim , Hongming Pu

Reinforcement learning (RL) is well known for requiring large amounts of data in order for RL agents to learn to perform complex tasks. Recent progress in model-based RL allows agents to be much more data-efficient, as it enables them to…

Machine Learning · Computer Science 2021-08-17 Remo Sasso , Matthia Sabatelli , Marco A. Wiering

Transfer learning is focused on the reuse of supervised learning models in a new context. Prominent applications can be found in robotics, image processing or web mining. In these fields, the learning scenarios are naturally changing but…

Machine Learning · Computer Science 2020-07-15 Christoph Raab , Frank-Michael Schleif

In a Massive Open Online Course (MOOC), predictive models of student behavior can support multiple aspects of learning, including instructor feedback and timely intervention. Ongoing courses, when the student outcomes are yet unknown, must…

Machine Learning · Computer Science 2018-12-19 Mucong Ding , Yanbang Wang , Erik Hemberg , Una-May O'Reilly

Many modern learning tasks require models that can take inputs of varying sizes. Consequently, dimension-independent architectures have been proposed for domains where the inputs are graphs, sets, and point clouds. Recent work on graph…

Machine Learning · Computer Science 2026-02-12 Eitan Levin , Yuxin Ma , Mateo Díaz , Soledad Villar

Transfer learning aims to leverage models pre-trained on source data to efficiently adapt to target setting, where only limited data are available for model fine-tuning. Recent works empirically demonstrate that adversarial training in the…

Machine Learning · Computer Science 2021-06-21 Zhun Deng , Linjun Zhang , Kailas Vodrahalli , Kenji Kawaguchi , James Zou

In this paper, we propose an environment sensing-aided beam prediction model for smart factory that can be transferred from given environments to a new environment. In particular, we first design a pre-training model that predicts the…

Signal Processing · Electrical Eng. & Systems 2024-05-27 Yuan Feng , Chuanbing Zhao , Feifei Gao , Yong Zhang , Shaodan Ma

In complex transfer learning scenarios new tasks might not be tightly linked to previous tasks. Approaches that transfer information contained only in the final parameters of a source model will therefore struggle. Instead, transfer…

Machine Learning · Computer Science 2019-03-25 Sebastian Flennerhag , Pablo G. Moreno , Neil D. Lawrence , Andreas Damianou

Deep learning is known to be data-hungry, which hinders its application in many areas of science when datasets are small. Here, we propose to use transfer learning methods to migrate knowledge between different physical scenarios and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Yurui Qu , Li Jing , Yichen Shen , Min Qiu , Marin Soljacic

Recommender systems support decisions in various domains ranging from simple items such as books and movies to more complex items such as financial services, telecommunication equipment, and software systems. In this context,…

Information Retrieval · Computer Science 2021-02-15 Alexander Felfernig , Viet-Man Le , Andrei Popescu , Mathias Uta , Thi Ngoc Trang Tran , Müslüum Atas

Transfer learning is an exciting area of Natural Language Processing that has the potential to both improve model performance and increase data efficiency. This study explores the effects of varying quantities of target task training data…

Computation and Language · Computer Science 2022-10-24 Josiah Ross , Luke Yoffe , Alon Albalak , William Yang Wang

The use of machine learning in chemistry has become a common practice. At the same time, despite the success of modern machine learning methods, the lack of data limits their use. Using a transfer learning methodology can help solve this…

Machine Learning · Computer Science 2021-07-26 Kirill Karpov , Artem Mitrofanov , Vadim Korolev , Valery Tkachenko

In this work we propose simple, effective and computationally efficient transfer learning approaches for structure-property relation predictions in the context of materials, with highly informative input from different modalities. As…

Materials Science · Physics 2024-12-11 Dario Massa , Grzegorz Kaszuba , Stefanos Papanikolaou , Piotr Sankowski

We conduct the first empirical study on using knowledge transfer to improve the generalization ability of large language models (LLMs) in software engineering tasks, which often require LLMs to generalize beyond their training data. Our…

Software Engineering · Computer Science 2023-08-10 Qing Huang , Yishun Wu , Zhenchang Xing , He Jiang , Yu Cheng , Huan Jin

Parameter sharing has proven to be a parameter-efficient approach. Previous work on Transformers has focused on sharing parameters in different layers, which can improve the performance of models with limited parameters by increasing model…

Machine Learning · Computer Science 2023-06-19 Ye Lin , Mingxuan Wang , Zhexi Zhang , Xiaohui Wang , Tong Xiao , Jingbo Zhu

Performance optimization is an increasingly challenging but often repetitive task. While each platform has its quirks, the underlying code transformations rely on data movement and computational characteristics that recur across…

Software Engineering · Computer Science 2023-03-16 Lukas Trümper , Tal Ben-Nun , Philipp Schaad , Alexandru Calotoiu , Torsten Hoefler