English
Related papers

Related papers: Transfer Learning in Regression with Influential P…

200 papers

Reinforcement learning (RL) is well known for requiring large amounts of data in order for RL agents to learn to perform complex tasks. Recent progress in model-based RL allows agents to be much more data-efficient, as it enables them to…

Machine Learning · Computer Science 2021-08-17 Remo Sasso , Matthia Sabatelli , Marco A. Wiering

Transfer learning aims to leverage models pre-trained on source data to efficiently adapt to target setting, where only limited data are available for model fine-tuning. Recent works empirically demonstrate that adversarial training in the…

Machine Learning · Computer Science 2021-06-21 Zhun Deng , Linjun Zhang , Kailas Vodrahalli , Kenji Kawaguchi , James Zou

Deep neural networks produce state-of-the-art results when trained on a large number of labeled examples but tend to overfit when small amounts of labeled examples are used for training. Creating a large number of labeled examples requires…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Attaullah Sahito , Eibe Frank , Bernhard Pfahringer

In this study, we present a transductive inference approach on that reward information propagation graph, which enables the effective estimation of rewards for unlabelled data in offline reinforcement learning. Reward inference is the key…

Machine Learning · Computer Science 2024-02-07 Bohao Qu , Xiaofeng Cao , Qing Guo , Yi Chang , Ivor W. Tsang , Chengqi Zhang

Transfer learning refers to the process of adapting a model trained on a source task to a target task. While kernel methods are conceptually and computationally simple machine learning models that are competitive on a variety of tasks, it…

Machine Learning · Computer Science 2022-11-02 Adityanarayanan Radhakrishnan , Max Ruiz Luyten , Neha Prasad , Caroline Uhler

Transfer learning is an umbrella term for machine learning approaches that leverage knowledge gained from solving one problem (the source domain) to improve speed, efficiency, and data requirements in solving a different but related problem…

Systems and Control · Electrical Eng. & Systems 2024-12-03 Alireza Nadali , Bingzhuo Zhong , Ashutosh Trivedi , Majid Zamani

While neural networks have shown impressive performance on large datasets, applying these models to tasks where little data is available remains a challenging problem. In this paper we propose to use feature transfer in a zero-shot…

Computation and Language · Computer Science 2018-08-30 Javid Dadashkarimi , Alexander Fabbri , Sekhar Tatikonda , Dragomir R. Radev

Cross-domain time series imputation is an underexplored data-centric research task that presents significant challenges, particularly when the target domain suffers from high missing rates and domain shifts in temporal dynamics. Existing…

Machine Learning · Computer Science 2025-06-17 Kexin Zhang , Baoyu Jing , K. Selçuk Candan , Dawei Zhou , Qingsong Wen , Han Liu , Kaize Ding

Transfer learning can significantly improve the sample efficiency of neural networks, by exploiting the relatedness between a data-scarce target task and a data-abundant source task. Despite years of successful applications, transfer…

Machine Learning · Computer Science 2023-06-06 Federica Gerace , Luca Saglietti , Stefano Sarao Mannelli , Andrew Saxe , Lenka Zdeborová

Quantifying the impact of training data points is crucial for understanding the outputs of machine learning models and for improving the transparency of the AI pipeline. The influence function is a principled and popular data attribution…

Machine Learning · Computer Science 2024-03-14 Yongchan Kwon , Eric Wu , Kevin Wu , James Zou

Diffusion models, a specific type of generative model, have achieved unprecedented performance in recent years and consistently produce high-quality synthetic samples. A critical prerequisite for their notable success lies in the presence…

Machine Learning · Computer Science 2024-11-01 Yidong Ouyang , Liyan Xie , Hongyuan Zha , Guang Cheng

Transfer learning is an important field of machine learning in general, and particularly in the context of fully autonomous driving, which needs to be solved simultaneously for many different domains, such as changing weather conditions and…

Machine Learning · Computer Science 2020-04-28 Oliver Scheel , Loren Schwarz , Nassir Navab , Federico Tombari

Transfer learning is the predominant paradigm for training deep networks on small target datasets. Models are typically pretrained on large ``upstream'' datasets for classification, as such labels are easy to collect, and then finetuned on…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Anurag Arnab , Xuehan Xiong , Alexey Gritsenko , Rob Romijnders , Josip Djolonga , Mostafa Dehghani , Chen Sun , Mario Lučić , Cordelia Schmid

Transfer learning enhances model performance in a target population with limited samples by leveraging knowledge from related studies. While many works focus on improving predictive performance, challenges of statistical inference persist.…

Methodology · Statistics 2024-12-05 Daoyuan Lai , Oscar Hernan Madrid Padilla , Tian Gu

The recent success of deep neural networks relies on massive amounts of labeled data. For a target task where labeled data is unavailable, domain adaptation can transfer a learner from a different source domain. In this paper, we propose a…

Machine Learning · Computer Science 2017-02-17 Mingsheng Long , Han Zhu , Jianmin Wang , Michael I. Jordan

Face attribute evaluation plays an important role in video surveillance and face analysis. Although methods based on convolution neural networks have made great progress, they inevitably only deal with one local neighborhood with…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Decheng Liu , Weijie He , Chunlei Peng , Nannan Wang , Jie Li , Xinbo Gao

Using transfer learning to adapt a pre-trained "source model" to a downstream "target task" can dramatically increase performance with seemingly no downside. In this work, we demonstrate that there can exist a downside after all: bias…

Machine Learning · Computer Science 2022-07-07 Hadi Salman , Saachi Jain , Andrew Ilyas , Logan Engstrom , Eric Wong , Aleksander Madry

The ability to infer the intentions of others, predict their goals, and deduce their plans are critical features for intelligent agents. For a long time, several approaches investigated the use of symbolic representations and inferences…

Machine Learning · Computer Science 2019-11-25 Thibault Duhamel , Mariane Maynard , Froduald Kabanza

In this paper, we present a new approach to Transfer Learning (TL) in Reinforcement Learning (RL) for cross-domain tasks. Many of the available techniques approach the transfer architecture as a method of speeding up the target task…

Artificial Intelligence · Computer Science 2018-01-23 Girish Joshi , Girish Chowdhary

Transfer learning methods, and in particular domain adaptation, help exploit labeled data in one domain to improve the performance of a certain task in another domain. However, it is still not clear what factors affect the success of domain…

Computation and Language · Computer Science 2021-06-25 Nicolai Pogrebnyakov , Shohreh Shaghaghian