English
Related papers

Related papers: Transferring model structure in Bayesian transfer …

200 papers

The classical approach to non-linear regression in physics, is to take a mathematical model describing the functional dependence of the dependent variable from a set of independent variables, and then, using non-linear fitting algorithms,…

Machine Learning · Computer Science 2020-07-29 Umberto , Michelucci , Francesca Venturini

Transfer learning has been demonstrated to be successful and essential in diverse applications, which transfers knowledge from related but different source domains to the target domain. Online transfer learning(OTL) is a more challenging…

Machine Learning · Computer Science 2020-02-12 Yuntao Du , Zhiwen Tan , Qian Chen , Yi Zhang , Chongjun Wang

This paper studies the problem of distributed classification with a network of heterogeneous agents. The agents seek to jointly identify the underlying target class that best describes a sequence of observations. The problem is first…

Artificial Intelligence · Computer Science 2020-11-24 James Z. Hare , Cesar A. Uribe , Lance Kaplan , Ali Jadbabaie

Most existing studies on few-shot learning focus on unimodal settings, where models are trained to generalize to unseen data using a limited amount of labeled examples from a single modality. However, real-world data are inherently…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zhengwei Yang , Yuke Li , Qiang Sun , Basura Fernando , Heng Huang , Zheng Wang

Transfer learning eases the burden of training a well-performed model from scratch, especially when training data is scarce and computation power is limited. In deep learning, a typical strategy for transfer learning is to freeze the early…

Machine Learning · Computer Science 2021-06-15 Dian Chen , Hongxin Hu , Qian Wang , Yinli Li , Cong Wang , Chao Shen , Qi Li

Recent trends in the machine learning community show that models with fidelity toward human perceptual measurements perform strongly on vision tasks. Likewise, human behavioral measurements have been used to regularize model performance.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Justin Dulay , Walter J. Scheirer

Robust decision making involves making decisions in the presence of uncertainty and is often used in critical domains such as healthcare, supply chains, and finance. Causality plays a crucial role in decision-making as it predicts the…

Methodology · Statistics 2025-07-23 Saideep Nannapaneni , Joseph Sakaya , Kyle Caron , Pedro HM Albuquerque , Zaid Tashman

Neural machine translation is known to require large numbers of parallel training sentences, which generally prevent it from excelling on low-resource language pairs. This thesis explores the use of cross-lingual transfer learning on neural…

Computation and Language · Computer Science 2020-01-07 Tom Kocmi

Multi-Task Learning (MTL) networks have emerged as a promising method for transferring learned knowledge across different tasks. However, MTL must deal with challenges such as: overfitting to low resource tasks, catastrophic forgetting, and…

Machine Learning · Computer Science 2022-04-22 Jonathan Pilault , Amine Elhattami , Christopher Pal

This article tackles the old problem of prediction via a nonparametric transformation model (NTM) in a new Bayesian way. Estimation of NTMs is known challenging due to model unidentifiability though appealing because of its robust…

Methodology · Statistics 2023-02-08 Chong Zhong , Jin Yang , Junshan Shen , Catherine Liu , Zhaohai Li

Multi-Task Learning (MTL) is a powerful learning paradigm to improve generalization performance via knowledge sharing. However, existing studies find that MTL could sometimes hurt generalization, especially when two tasks are less…

Machine Learning · Computer Science 2022-11-28 Ziniu Hu , Zhe Zhao , Xinyang Yi , Tiansheng Yao , Lichan Hong , Yizhou Sun , Ed H. Chi

This paper explores transfer learning in heterogeneous multi-source environments with distributional divergence between target and auxiliary domains. To address challenges in statistical bias and computational efficiency, we propose a…

Machine Learning · Statistics 2025-04-08 Chenqi Gong , Hu Yang

Transferring knowledge across tasks to improve data-efficiency is one of the open key challenges in the field of global black-box optimization. Readily available algorithms are typically designed to be universal optimizers and, therefore,…

When hyperparameter optimization of a machine learning algorithm is repeated for multiple datasets it is possible to transfer knowledge to an optimization run on a new dataset. We develop a new hyperparameter-free ensemble model for…

Machine Learning · Statistics 2022-10-25 Matthias Feurer , Benjamin Letham , Frank Hutter , Eytan Bakshy

In this paper, we study transfer learning for high-dimensional factor-augmented sparse linear models, motivated by applications in economics and finance where strongly correlated predictors and latent factor structures pose major challenges…

Methodology · Statistics 2026-03-23 Bo Fu , Dandan Jiang

In this paper we consider the binary transfer learning problem, focusing on how to select and combine sources from a large pool to yield a good performance on a target task. Constraining our scenario to real world, we do not assume the…

Computer Vision and Pattern Recognition · Computer Science 2016-09-16 Ilja Kuzborskij , Francesco Orabona , Barbara Caputo

Multi-source transfer learning provides an effective solution to data scarcity in real-world supervised learning scenarios by leveraging multiple source tasks. In this field, existing works typically use all available samples from sources…

Machine Learning · Computer Science 2025-10-29 Qingyue Zhang , Haohao Fu , Guanbo Huang , Yaoyuan Liang , Chang Chu , Tianren Peng , Yanru Wu , Qi Li , Yang Li , Shao-Lun Huang

Bayesian Reinforcement Learning (BRL), a subclass of Meta-Reinforcement Learning (Meta-RL), provides a principled framework for generalisation by explicitly incorporating Bayesian task parameters into transition and reward models. However,…

Machine Learning · Computer Science 2026-05-11 Jingyang You , Hanna Kurniawati

Distribution regression has recently attracted much interest as a generic solution to the problem of supervised learning where labels are available at the group level, rather than at the individual level. Current approaches, however, do not…

Machine Learning · Statistics 2021-01-18 Ho Chung Leon Law , Danica J. Sutherland , Dino Sejdinovic , Seth Flaxman

In this paper the problem of learning appropriate bias for an environment of related tasks is examined from a Bayesian perspective. The environment of related tasks is shown to be naturally modelled by the concept of an {\em objective}…

Machine Learning · Computer Science 2019-11-15 Jonathan Baxter