English
Related papers

Related papers: Trustworthy Transfer Learning: A Survey

200 papers

In transfer learning, we wish to make inference about a target population when we have access to data both from the distribution itself, and from a different but related source distribution. We introduce a flexible framework for transfer…

Machine Learning · Statistics 2021-09-03 Henry W. J. Reeve , Timothy I. Cannings , Richard J. Samworth

Ensuring generalization to unseen environments remains a challenge. Domain shift can lead to substantially degraded performance unless shifts are well-exercised within the available training environments. We introduce a simple robust…

Machine Learning · Computer Science 2021-10-20 Yilun Xu , Tommi Jaakkola

In this work, we study the transfer learning problem under high-dimensional generalized linear models (GLMs), which aim to improve the fit on target data by borrowing information from useful source data. Given which sources to transfer, we…

Machine Learning · Statistics 2022-04-19 Ye Tian , Yang Feng

Transfer learning has become an essential technique for utilizing information from source datasets to improve the performance of the target task. However, in the context of high-dimensional data, heterogeneity arises due to heteroscedastic…

Methodology · Statistics 2024-06-26 Xiaohui Yuan , Shujie Ren

Lack of sufficient labeled data often limits the applicability of advanced machine learning algorithms to real life problems. However efficient use of Transfer Learning (TL) has been shown to be very useful across domains. TL utilizes…

Computation and Language · Computer Science 2017-08-15 Sunil Kumar Sahu , Ashish Anand

Knowledge transfer between heterogeneous source and target networks and tasks has received a lot of attention in recent times as large amounts of quality labeled data can be difficult to obtain in many applications. Existing approaches…

Machine Learning · Computer Science 2022-03-17 Keerthiram Murugesan , Vijay Sadashivaiah , Ronny Luss , Karthikeyan Shanmugam , Pin-Yu Chen , Amit Dhurandhar

Traditional information retrieval (such as that offered by web search engines) impedes users with information overload from extensive result pages and the need to manually locate the desired information therein. Conversely,…

Computation and Language · Computer Science 2019-03-11 Bernhard Kratzwald , Stefan Feuerriegel

Modern software systems provide many configuration options which significantly influence their non-functional properties. To understand and predict the effect of configuration options, several sampling and learning strategies have been…

Machine Learning · Statistics 2017-09-08 Pooyan Jamshidi , Norbert Siegmund , Miguel Velez , Christian Kästner , Akshay Patel , Yuvraj Agarwal

Transfer learning has emerged as a powerful methodology for adapting pre-trained deep neural networks on image recognition tasks to new domains. This process consists of taking a neural network pre-trained on a large feature-rich source…

Machine Learning · Computer Science 2021-04-27 Francisco Utrera , Evan Kravitz , N. Benjamin Erichson , Rajiv Khanna , Michael W. Mahoney

Recent advances in training multilingual language models on large datasets seem to have shown promising results in knowledge transfer across languages and achieve high performance on downstream tasks. However, we question to what extent the…

Computation and Language · Computer Science 2024-02-06 Sara Rajaee , Christof Monz

Machine learning relies on the availability of a vast amount of data for training. However, in reality, most data are scattered across different organizations and cannot be easily integrated under many legal and practical constraints. In…

Machine Learning · Computer Science 2020-06-25 Yang Liu , Yan Kang , Chaoping Xing , Tianjian Chen , Qiang Yang

Sharing knowledge between tasks is vital for efficient learning in a multi-task setting. However, most research so far has focused on the easier case where knowledge transfer is not harmful, i.e., where knowledge from one task cannot…

Machine Learning · Computer Science 2019-07-08 Timo Bram , Gino Brunner , Oliver Richter , Roger Wattenhofer

In open-ended continuous environments, robots need to learn multiple parameterised control tasks in hierarchical reinforcement learning. We hypothesise that the most complex tasks can be learned more easily by transferring knowledge from…

Artificial Intelligence · Computer Science 2021-02-22 Nicolas Duminy , Sao Mai Nguyen , Junshuai Zhu , Dominique Duhaut , Jerome Kerdreux

Feature-based transfer is one of the most effective methodologies for transfer learning. Existing studies usually assume that the learned new feature representation is \emph{domain-invariant}, and thus train a transfer model $\mathcal{M}$…

Machine Learning · Computer Science 2022-04-22 Pengfei Wei , Xinghua Qu , Yew Soon Ong , Zejun Ma

Predictive analytics is widely used in learning analytics, but many resource-constrained institutions lack the capacity to develop their own models or rely on proprietary ones trained in different contexts with little transparency. Transfer…

Computers and Society · Computer Science 2025-01-14 Chengyuan Yao , Carmen Cortez , Renzhe Yu

Knowledge transfer across sensing technology is a novel concept that has been recently explored in many application domains, including gesture-based human computer interaction. The main aim is to gather semantic or data driven information…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Payal Kamboj , Ayan Banerjee , Sandeep K. S. Gupta

In the past few decades, artificial intelligence (AI) technology has experienced swift developments, changing everyone's daily life and profoundly altering the course of human society. The intention of developing AI is to benefit humans, by…

Artificial Intelligence · Computer Science 2021-08-20 Haochen Liu , Yiqi Wang , Wenqi Fan , Xiaorui Liu , Yaxin Li , Shaili Jain , Yunhao Liu , Anil K. Jain , Jiliang Tang

A common practice of ML systems development concerns the training of the same model under different data sets, and the use of the same (training and test) sets for different learning models. The first case is a desirable practice for…

Logic in Computer Science · Computer Science 2025-06-06 Leonardo Ceragioli , Giuseppe Primiero

Randomized clinical trials are the gold standard for analyzing treatment effects, but high costs and ethical concerns can limit recruitment, potentially leading to invalid inferences. Incorporating external trial data with similar…

Methodology · Statistics 2024-09-09 Yujia Gu , Hanzhong Liu , Wei Ma

Transfer learning aims to learn classifiers for a target domain by transferring knowledge from a source domain. However, due to two main issues: feature discrepancy and distribution divergence, transfer learning can be a very difficult…

Machine Learning · Computer Science 2022-09-05 Md Geaur Rahman , Md Zahidul Islam