English
Related papers

Related papers: Spatial Transfer Learning with Simple MLP

200 papers

The widespread dissemination of machine learning tools in science, particularly in astronomy, has revealed the limitation of working with simple single-task scenarios in which any task in need of a predictive model is looked in isolation,…

High Energy Astrophysical Phenomena · Physics 2018-12-27 Ricardo Vilalta

In the current work, a problem-splitting approach and a scheme motivated by transfer learning is applied to a structural health monitoring problem. The specific problem in this case is that of localising damage on an aircraft wing. The…

Machine Learning · Computer Science 2022-03-04 G. Tsialiamanis , D. J. Wagg , P. A. Gardner , N. Dervilis , K. Worden

Transfer learning is an emerging and popular paradigm for utilizing existing knowledge from previous learning tasks to improve the performance of new ones. In this paper, we propose a novel concept of transfer risk and and analyze its…

Mathematical Finance · Quantitative Finance 2023-11-07 Haoyang Cao , Haotian Gu , Xin Guo , Mathieu Rosenbaum

Recent research shows synthetic data as a source of supervision helps pretrained language models (PLM) transfer learning to new target tasks/domains. However, this idea is less explored for spatial language. We provide two new data…

Computation and Language · Computer Science 2022-11-07 Roshanak Mirzaee , Parisa Kordjamshidi

Machine learning techniques have been widely used in attempts to forecast several solar datasets. Most of these approaches employ supervised machine learning algorithms which are, in general, very data hungry. This hampers the attempts to…

Solar and Stellar Astrophysics · Physics 2023-08-07 Eurico Covas

Transfer learning is a standard technique to improve performance on tasks with limited data. However, for medical imaging, the value of transfer learning is less clear. This is likely due to the large domain mismatch between the usual…

Transfer reinforcement learning (RL) methods leverage on the experience collected on a set of source tasks to speed-up RL algorithms. A simple and effective approach is to transfer samples from source tasks and include them into the…

Artificial Intelligence · Computer Science 2011-09-02 Alessandro Lazaric , Marcello Restelli

Transfer learning has been proven as an effective technique for neural machine translation under low-resource conditions. Existing methods require a common target language, language relatedness, or specific training tricks and regimes. We…

Computation and Language · Computer Science 2020-07-09 Tom Kocmi , Ondřej Bojar

We propose a novel framework for exploring generalization errors of transfer learning through the lens of differential calculus on the space of probability measures. In particular, we consider two main transfer learning scenarios,…

Machine Learning · Statistics 2024-10-24 Gholamali Aminian , Łukasz Szpruch , Samuel N. Cohen

Transfer learning (TL) is a promising way to improve the sample efficiency of reinforcement learning. However, how to efficiently transfer knowledge across tasks with different state-action spaces is investigated at an early stage. Most…

Machine Learning · Computer Science 2021-05-11 Yu Chen , Yingfeng Chen , Zhipeng Hu , Tianpei Yang , Changjie Fan , Yang Yu , Jianye Hao

Modern software systems provide many configuration options which significantly influence their non-functional properties. To understand and predict the effect of configuration options, several sampling and learning strategies have been…

Machine Learning · Statistics 2017-09-08 Pooyan Jamshidi , Norbert Siegmund , Miguel Velez , Christian Kästner , Akshay Patel , Yuvraj Agarwal

Transfer learning, also referred as knowledge transfer, aims at reusing knowledge from a source dataset to a similar target one. While many empirical studies illustrate the benefits of transfer learning, few theoretical results are…

Statistics Theory · Mathematics 2021-02-19 David Obst , Badih Ghattas , Jairo Cugliari , Georges Oppenheim , Sandra Claudel , Yannig Goude

We propose a transfer learning method that utilizes data representations in a semiparametric regression model. Our aim is to perform statistical inference on the parameter of primary interest in the target model while accounting for…

Methodology · Statistics 2024-06-21 Baihua He , Huihang Liu , Xinyu Zhang , Jian Huang

Clustering in high dimension spaces is a difficult task; the usual distance metrics may no longer be appropriate under the curse of dimensionality. Indeed, the choice of the metric is crucial, and it is highly dependent on the dataset…

Machine Learning · Computer Science 2023-02-14 Simo Alami. C , Rim Kaddah , Jesse Read

The recent progresses in Machine Learning opened the door to actual applications of learning algorithms but also to new research directions both in the field of Machine Learning directly and, at the edges with other disciplines. The case…

Disordered Systems and Neural Networks · Physics 2023-07-17 Aurélien Decelle

Deep learning has established the state of the art in multiple fields, including hyperspectral image analysis. However, training large-capacity learners to segment such imagery requires representative training sets. Acquiring such data is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Jakub Nalepa , Michal Myller , Michal Kawulok

Understanding how information propagates in real-life complex networks yields a better understanding of dynamic processes such as misinformation or epidemic spreading. The recently introduced branch of machine learning methods for learning…

Social and Information Networks · Computer Science 2023-02-21 Sebastian Mežnar , Nada Lavrač , Blaž Škrlj

One desired capability for machines is the ability to transfer their knowledge of one domain to another where data is (usually) scarce. Despite ample adaptation of transfer learning in various deep learning applications, we yet do not…

Machine Learning · Computer Science 2021-01-18 Behnam Neyshabur , Hanie Sedghi , Chiyuan Zhang

Spatial-temporal prediction is a fundamental problem for constructing smart city, which is useful for tasks such as traffic control, taxi dispatching, and environmental policy making. Due to data collection mechanism, it is common to see…

Machine Learning · Computer Science 2020-08-25 Huaxiu Yao , Yiding Liu , Ying Wei , Xianfeng Tang , Zhenhui Li

Through this project, we researched on transfer learning methods and their applications on real world problems. By implementing and modifying various methods in transfer learning for our problem, we obtained an insight in the advantages and…

Machine Learning · Computer Science 2017-07-11 Hailin Chen , Shengping Cui , Sebastian Li