English
Related papers

Related papers: Transfer learning via interpolating structures

200 papers

Transfer learning seeks to improve the generalization performance of a target task by exploiting the knowledge learned from a related source task. Central questions include deciding what information one should transfer and when transfer can…

Machine Learning · Computer Science 2021-04-07 Oussama Dhifallah , Yue M. Lu

Knowledge transfer from a complex high performing model to a simpler and potentially low performing one in order to enhance its performance has been of great interest over the last few years as it finds applications in important problems…

Machine Learning · Computer Science 2022-09-09 Amit Dhurandhar , Tejaswini Pedapati

Transfer learning is a popular technique for improving the performance of neural networks. However, existing methods are limited to transferring parameters between networks with same architectures. We present a method for transferring…

Machine Learning · Computer Science 2022-12-29 Maciej A. Czyzewski , Daniel Nowak , Kamil Piechowiak

Transfer learning, also referred as knowledge transfer, aims at reusing knowledge from a source dataset to a similar target one. While many empirical studies illustrate the benefits of transfer learning, few theoretical results are…

Statistics Theory · Mathematics 2021-02-19 David Obst , Badih Ghattas , Jairo Cugliari , Georges Oppenheim , Sandra Claudel , Yannig Goude

Development of comprehensive prediction models are often of great interest in many disciplines of science, but datasets with information on all desired features often have small sample sizes. We describe a transfer learning approach for…

Methodology · Statistics 2024-08-20 Ruzhang Zhao , Prosenjit Kundu , Arkajyoti Saha , Nilanjan Chatterjee

Traffic speed prediction is the key to many valuable applications, and it is also a challenging task because of its various influencing factors. Recent work attempts to obtain more information through various hybrid models, thereby…

Machine Learning · Computer Science 2022-07-25 Pengyu Fu , Liang Chu , Zhuoran Hou , Jincheng Hu , Yanjun Huang , Yuanjian Zhang

Federated learning is an emerging research paradigm enabling collaborative training of machine learning models among different organizations while keeping data private at each institution. Despite recent progress, there remain fundamental…

Machine Learning · Computer Science 2022-04-15 Liangqiong Qu , Yuyin Zhou , Paul Pu Liang , Yingda Xia , Feifei Wang , Ehsan Adeli , Li Fei-Fei , Daniel Rubin

Precise and reliable climate projections are required for climate adaptation and mitigation, but Earth system models still exhibit great uncertainties. Several approaches have been developed to reduce the spread of climate projections and…

Diffusion Bridge and Flow Matching have both demonstrated compelling empirical performance in transformation between arbitrary distributions. However, there remains confusion about which approach is generally preferable, and the substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Kaizhen Zhu , Mokai Pan , Zhechuan Yu , Jingya Wang , Jingyi Yu , Ye Shi

Transfer learning has emerged as a highly sought-after and actively pursued research area within the statistical community. The core concept of transfer learning involves leveraging insights and information from auxiliary datasets to…

Methodology · Statistics 2024-08-01 Pengfei Li , Tao Yu , Chixiang Chen , Jing Qin

In the current work, a problem-splitting approach and a scheme motivated by transfer learning is applied to a structural health monitoring problem. The specific problem in this case is that of localising damage on an aircraft wing. The…

Machine Learning · Computer Science 2022-03-04 G. Tsialiamanis , D. J. Wagg , P. A. Gardner , N. Dervilis , K. Worden

Modality translation is inherently under-constrained, as multiple cross-modal mappings may yield the same marginals. Recent work has shown that diffusion bridges are effective for this task. However, most existing approaches rely on fully…

Machine Learning · Computer Science 2026-05-13 Eitan Kosman , Gabriele Serussi , Chaim Baskin

The interaction of neural networks with physical equations offers a wide range of applications. We provide a method which enables a neural network to transform objects subject to given physical constraints. Therefore an U-Net architecture…

Artificial Intelligence · Computer Science 2021-03-22 Lukas Harsch , Johannes Burgbacher , Stefan Riedelbauch

Stochastically evolving geometric systems are studied in shape analysis and computational anatomy for modelling random evolutions of human organ shapes. The notion of geodesic paths between shapes is central to shape analysis and has a…

Numerical Analysis · Mathematics 2022-12-01 Alexis Arnaudon , Frank van der Meulen , Moritz Schauer , Stefan Sommer

In recent years, supervised machine learning models have demonstrated tremendous success in a variety of application domains. Despite the promising results, these successful models are data hungry and their performance relies heavily on the…

Machine Learning · Computer Science 2018-12-05 Azin Asgarian , Parinaz Sobhani , Ji Chao Zhang , Madalin Mihailescu , Ariel Sibilia , Ahmed Bilal Ashraf , Babak Taati

The modeling of the spreading of communicable diseases has experienced significant advances in the last two decades or so. This has been possible due to the proliferation of data and the development of new methods to gather, mine and…

Physics and Society · Physics 2020-09-09 Alberto Aleta , Guilherme Ferraz de Arruda , Yamir Moreno

Deep learning is known to be data-hungry, which hinders its application in many areas of science when datasets are small. Here, we propose to use transfer learning methods to migrate knowledge between different physical scenarios and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Yurui Qu , Li Jing , Yichen Shen , Min Qiu , Marin Soljacic

Transfer learning is a powerful technique for knowledge-sharing between different tasks. Recent work has found that the representations of models with certain invariances, such as to adversarial input perturbations, achieve higher…

Machine Learning · Computer Science 2024-07-08 Till Speicher , Vedant Nanda , Krishna P. Gummadi

Flow and bridge matching are a novel class of processes which encompass diffusion models. One of the main aspect of their increased flexibility is that these models can interpolate between arbitrary data distributions i.e. they generalize…

Machine Learning · Computer Science 2023-11-14 Valentin De Bortoli , Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou , Weilie Nie

In practice, it is very demanding and sometimes impossible to collect datasets of tagged data large enough to successfully train a machine learning model, and one possible solution to this problem is transfer learning. This study aims to…

Machine Learning · Computer Science 2022-01-13 Erik Otović , Marko Njirjak , Dario Jozinović , Goran Mauša , Alberto Michelini , Ivan Štajduhar