English
Related papers

Related papers: Deep Transfer $Q$-Learning for Offline Non-Station…

200 papers

Deep neural networks are data hungry models and thus face difficulties when attempting to train on small text datasets. Transfer learning is a potential solution but their effectiveness in the text domain is not as explored as in areas such…

Machine Learning · Computer Science 2019-01-28 Yaser Keneshloo , Naren Ramakrishnan , Chandan K. Reddy

In recent years, deep learning models have shown great potential in source code modeling and analysis. Generally, deep learning-based approaches are problem-specific and data-hungry. A challenging issue of these approaches is that they…

Machine Learning · Computer Science 2020-07-15 Yasir Hussain , Zhiqiu Huang , Yu Zhou , Senzhang Wang

We study the Non-Stationary Reinforcement Learning (RL) under distribution shifts in both finite-horizon episodic and infinite-horizon discounted Markov Decision Processes (MDPs). In the finite-horizon case, the transition functions may…

Machine Learning · Computer Science 2026-03-31 Ha Manh Bui , Felix Parker , Kimia Ghobadi , Anqi Liu

As a paradigm for sequential decision making in unknown environments, reinforcement learning (RL) has received a flurry of attention in recent years. However, the explosion of model complexity in emerging applications and the presence of…

Machine Learning · Statistics 2025-07-22 Yuejie Chi , Yuxin Chen , Yuting Wei

Optimized control of quantum networks is essential for enabling distributed quantum applications with strict performance requirements. In near-term architectures with constrained hardware, effective control may determine the feasibility of…

Transferring knowledge across a sequence of reinforcement-learning tasks is challenging, and has a number of important applications. Though there is encouraging empirical evidence that transfer can improve performance in subsequent…

Machine Learning · Computer Science 2013-09-27 Emma Brunskill , Lihong Li

Recent advance in deep offline reinforcement learning (RL) has made it possible to train strong robotic agents from offline datasets. However, depending on the quality of the trained agents and the application being considered, it is often…

Robotics · Computer Science 2021-11-02 Seunghyun Lee , Younggyo Seo , Kimin Lee , Pieter Abbeel , Jinwoo Shin

The widespread adoption of transfer learning has revolutionized machine learning by enabling efficient adaptation of pre-trained models to new domains. However, the reliability of these adaptations remains poorly understood, particularly…

Machine Learning · Computer Science 2025-09-01 Prabhav Singh , Jessica Sorrell

The field of Offline Reinforcement Learning (RL) aims to derive effective policies from pre-collected datasets without active environment interaction. While traditional offline RL algorithms like Conservative Q-Learning (CQL) and Implicit…

Machine Learning · Computer Science 2025-11-21 Ali Murtaza Caunhye , Asad Jeewa

This paper presents a framework for deep transfer learning, which aims to leverage information from multi-domain upstream data with a large number of samples $n$ to a single-domain downstream task with a considerably smaller number of…

Machine Learning · Computer Science 2025-01-07 Yuling Jiao , Huazhen Lin , Yuchen Luo , Jerry Zhijian Yang

Discrete diffusion models (DMs) have achieved strong performance in language and other discrete domains, offering a compelling alternative to autoregressive modeling. Yet this performance typically depends on large training datasets,…

Machine Learning · Computer Science 2026-04-16 Julian Kleutgens , Claudio Battiloro , Lingkai Kong , Benjamin Grewe , Francesca Dominici , Mauricio Tec

Deep reinforcement learning (RL) algorithms have achieved great success on a wide variety of sequential decision-making tasks. However, many of these algorithms suffer from high sample complexity when learning from scratch using…

Machine Learning · Statistics 2020-06-15 Michael Wan , Tanmay Gangwani , Jian Peng

Exploration and adaptation to new tasks in a transfer learning setup is a central challenge in reinforcement learning. In this work, we build on the idea of modeling a distribution over policies in a Bayesian deep reinforcement learning…

Machine Learning · Computer Science 2019-06-11 Disha Shrivastava , Eeshan Gunesh Dhekane , Riashat Islam

Controlled text generation tasks such as unsupervised text style transfer have increasingly adopted the use of Reinforcement Learning (RL). A major challenge in applying RL to such tasks is the sparse reward, which is available only after…

Computation and Language · Computer Science 2022-04-19 Bhargav Upadhyay , Akhilesh Sudhakar , Arjun Maheswaran

Pretraining reinforcement learning (RL) models on offline datasets is a promising way to improve their training efficiency in online tasks, but challenging due to the inherent mismatch in dynamics and behaviors across various tasks. We…

Machine Learning · Computer Science 2024-06-06 Minting Pan , Yitao Zheng , Yunbo Wang , Xiaokang Yang

Recent work on deep learning for tabular data demonstrates the strong performance of deep tabular models, often bridging the gap between gradient boosted decision trees and neural networks. Accuracy aside, a major advantage of neural models…

We propose a novel adaptive transfer learning framework, learning to transfer learn (L2TL), to improve performance on a target dataset by careful extraction of the related information from a source dataset. Our framework considers…

Machine Learning · Computer Science 2020-07-17 Linchao Zhu , Sercan O. Arik , Yi Yang , Tomas Pfister

Transfer learning is crucial in training deep neural networks on new target tasks. Current transfer learning methods always assume at least one of (i) source and target task label spaces overlap, (ii) source datasets are available, and…

Machine Learning · Computer Science 2025-02-21 Shin'ya Yamaguchi , Sekitoshi Kanai , Atsutoshi Kumagai , Daiki Chijiwa , Hisashi Kashima

Transfer learning has become an essential technique to exploit information from the source domain to boost performance of the target task. Despite the prevalence in high-dimensional data, heterogeneity and heavy tails are insufficiently…

Machine Learning · Statistics 2023-11-07 Jiayu Huang , Mingqiu Wang , Yuanshan Wu

Recent works have shown that tackling offline reinforcement learning (RL) with a conditional policy produces promising results. The Decision Transformer (DT) combines the conditional policy approach and a transformer architecture, showing…

Machine Learning · Computer Science 2023-05-26 Taku Yamagata , Ahmed Khalil , Raul Santos-Rodriguez