English
Related papers

Related papers: Model-based Transfer Learning for Automatic Optica…

200 papers

In multi-label learning, a particular case of multi-task learning where a single data point is associated with multiple target labels, it was widely assumed in the literature that, to obtain best accuracy, the dependence among the labels…

Machine Learning · Computer Science 2022-07-26 Jesse Read

Purpose: Surgery scene understanding with tool-tissue interaction recognition and automatic report generation can play an important role in intra-operative guidance, decision-making and postoperative analysis in robotic surgery. However,…

Artificial Intelligence · Computer Science 2022-11-29 Lalithkumar Seenivasan , Mobarakol Islam , Mengya Xu , Chwee Ming Lim , Hongliang Ren

When only limited target domain data is available, domain adaptation could be used to promote performance of deep neural network (DNN) acoustic model by leveraging well-trained source model and target domain data. However, suffering from…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-06 Han Zhu , Jiangjiang Zhao , Yuling Ren , Li Wang , Pengyuan Zhang

Transfer learning aims to leverage models pre-trained on source data to efficiently adapt to target setting, where only limited data are available for model fine-tuning. Recent works empirically demonstrate that adversarial training in the…

Machine Learning · Computer Science 2021-06-21 Zhun Deng , Linjun Zhang , Kailas Vodrahalli , Kenji Kawaguchi , James Zou

Hyperspectral image (HSI) classification presents inherent challenges due to high spectral dimensionality, significant domain shifts, and limited availability of labeled data. To address these issues, we propose a novel Active Transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Muhammad Ahmad , Francesco Mauro , Manuel Mazzara , Salvatore Distefano , Adil Mehmood Khan , Silvia Liberata Ullo

Transfer learning (TL) techniques, which leverage prior knowledge gained from data with different distributions to achieve higher performance and reduced training time, are often used in computer vision (CV) and natural language processing…

Signal Processing · Electrical Eng. & Systems 2022-10-05 Lauren J. Wong , Sean McPherson , Alan J. Michaels

This study presents an Adaptive Transfer Learning and Thresholding-based Deep Learning Model (ATL-TDLM) for automated breathing pattern recognition using thermal imaging. Unlike conventional methods that rely on sound-based respiratory…

Image and Video Processing · Electrical Eng. & Systems 2026-04-21 Hamza Kheddar , Yassine Himeur , Abbes Amira

We consider the Hypothesis Transfer Learning (HTL) problem where one incorporates a hypothesis trained on the source domain into the learning procedure of the target domain. Existing theoretical analysis either only studies specific…

Machine Learning · Statistics 2017-11-07 Simon Shaolei Du , Jayanth Koushik , Aarti Singh , Barnabas Poczos

If our models are used in new or unexpected cases, do we know if they will make fair predictions? Previously, researchers developed ways to debias a model for a single problem domain. However, this is often not how models are trained and…

Machine Learning · Computer Science 2019-11-18 Candice Schumann , Xuezhi Wang , Alex Beutel , Jilin Chen , Hai Qian , Ed H. Chi

Recent deep learning methods for object detection rely on a large amount of bounding box annotations. Collecting these annotations is laborious and costly, yet supervised models do not generalize well when testing on images from a different…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Han-Kai Hsu , Chun-Han Yao , Yi-Hsuan Tsai , Wei-Chih Hung , Hung-Yu Tseng , Maneesh Singh , Ming-Hsuan Yang

We address the challenge of getting efficient yet accurate recognition systems with limited labels. While recognition models improve with model size and amount of data, many specialized applications of computer vision have severe resource…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Kenneth Borup , Cheng Perng Phoo , Bharath Hariharan

In this paper, we propose to tackle the problem of reducing discrepancies between multiple domains referred to as multi-source domain adaptation and consider it under the target shift assumption: in all domains we aim to solve a…

Machine Learning · Statistics 2019-03-15 Ievgen Redko , Nicolas Courty , Rémi Flamary , Devis Tuia

Domain adaptation in reinforcement learning (RL) mainly deals with the changes of observation when transferring the policy to a new environment. Many traditional approaches of domain adaptation in RL manage to learn a mapping function…

Machine Learning · Computer Science 2023-06-14 Qi Yi , Rui Zhang , Shaohui Peng , Jiaming Guo , Yunkai Gao , Kaizhao Yuan , Ruizhi Chen , Siming Lan , Xing Hu , Zidong Du , Xishan Zhang , Qi Guo , Yunji Chen

Reliable and accurate estimation of the error of an ML model in unseen test domains is an important problem for safe intelligent systems. Prior work uses disagreement discrepancy (DIS^2) to derive practical error bounds under distribution…

Machine Learning · Computer Science 2025-06-19 Aayush Mishra , Anqi Liu

The ability to build a model on a source task and subsequently adapt such model on a new target task is a pervasive need in many astronomical applications. The problem is generally known as transfer learning in machine learning, where…

Machine Learning · Computer Science 2019-09-25 Ricardo Vilalta , Kinjal Dhar Gupta , Dainis Boumber , Mikhail M. Meskhi

Domain Adaptation (DA) enables transferring a learning machine from a labeled source domain to an unlabeled target one. While remarkable advances have been made, most of the existing DA methods focus on improving the target accuracy at…

Machine Learning · Computer Science 2020-11-10 Ximei Wang , Mingsheng Long , Jianmin Wang , Michael I. Jordan

Transfer learning techniques are particularly useful in NLP tasks where a sizable amount of high-quality annotated data is difficult to obtain. Current approaches directly adapt a pre-trained language model (LM) on in-domain text before…

We study linear regression under covariate shift, where the marginal distribution over the input covariates differs in the source and the target domains, while the conditional distribution of the output given the input covariates is similar…

Machine Learning · Computer Science 2022-08-04 Jingfeng Wu , Difan Zou , Vladimir Braverman , Quanquan Gu , Sham M. Kakade

Deep learning (DL) models for disease classification or segmentation from medical images are increasingly trained using transfer learning (TL) from unrelated natural world images. However, shortcomings and utility of TL for specialized…

Machine Learning · Statistics 2021-11-11 Sambuddha Ghosal , Pratik Shah

Domain adaptation helps transfer the knowledge gained from a labeled source domain to an unlabeled target domain. During the past few years, different domain adaptation techniques have been published. One common flaw of these approaches is…

Machine Learning · Computer Science 2020-12-25 Mohammad J. Hashemi , Eric Keller