English
Related papers

Related papers: Self-Attentional Credit Assignment for Transfer in…

200 papers

Options, which impose an inductive bias toward temporal and hierarchical structure, offer a powerful framework for reinforcement learning (RL). While effective in sequential decision-making, they are often handcrafted rather than learned.…

Machine Learning · Computer Science 2025-07-15 Harshil Kotamreddy , Marlos C. Machado

Inverse reinforcement learning (IRL) has progressed significantly toward accurately learning the underlying rewards in both discrete and continuous domains from behavior data. The next advance is to learn {\em intrinsic} preferences in ways…

Machine Learning · Computer Science 2026-05-28 Yikang Gui , Prashant Doshi

With widespread applications of artificial intelligence (AI), the capabilities of the perception, understanding, decision-making and control for autonomous systems have improved significantly in the past years. When autonomous systems…

Machine Learning · Computer Science 2020-05-26 Chongzhen Zhang , Jianrui Wang , Gary G. Yen , Chaoqiang Zhao , Qiyu Sun , Yang Tang , Feng Qian , Jürgen Kurths

Reinforcement Learning (RL) has proven highly effective in aligning Large Language Models (LLMs) with human preferences. Typical RL methods optimize under an overall sequence reward, which can lead to a suboptimal learning process. This…

Machine Learning · Computer Science 2025-02-26 Yanshi Li , Shaopan Xiong , Gengru Chen , Xiaoyang Li , Yijia Luo , Xingyuan Bu , Yingshui Tan , Wenbo Su , Bo Zheng

Transfer learning in Reinforcement Learning (RL) enables agents to leverage knowledge from source tasks to accelerate learning in target tasks. While prior work, such as the Attend, Adapt, and Transfer (A2T) framework, addresses negative…

Machine Learning · Computer Science 2025-07-08 Abhishek Verma , Nallarasan V , Balaraman Ravindran

Transfer learning enables to re-use knowledge learned on a source task to help learning a target task. A simple form of transfer learning is common in current state-of-the-art computer vision models, i.e. pre-training a model for image…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Thomas Mensink , Jasper Uijlings , Alina Kuznetsova , Michael Gygli , Vittorio Ferrari

In this paper, we explore the utilization of natural language to drive transfer for reinforcement learning (RL). Despite the wide-spread application of deep RL techniques, learning generalized policy representations that work across domains…

Computation and Language · Computer Science 2018-12-07 Karthik Narasimhan , Regina Barzilay , Tommi Jaakkola

The aim of Reinforcement Learning (RL) in real-world applications is to create systems capable of making autonomous decisions by learning from their environment through trial and error. This paper emphasizes the importance of reward…

Machine Learning · Computer Science 2024-12-31 Sinan Ibrahim , Mostafa Mostafa , Ali Jnadi , Hadi Salloum , Pavel Osinenko

We consider the transfer of experience samples (i.e., tuples < s, a, s', r >) in reinforcement learning (RL), collected from a set of source tasks to improve the learning process in a given target task. Most of the related approaches focus…

Machine Learning · Computer Science 2018-05-29 Andrea Tirinzoni , Andrea Sessa , Matteo Pirotta , Marcello Restelli

Reinforcement learning (RL) is a popular paradigm for addressing sequential decision tasks in which the agent has only limited environmental feedback. Despite many advances over the past three decades, learning in many domains still…

Machine Learning · Computer Science 2020-09-21 Sanmit Narvekar , Bei Peng , Matteo Leonetti , Jivko Sinapov , Matthew E. Taylor , Peter Stone

The great success of Transformer-based models benefits from the powerful multi-head self-attention mechanism, which learns token dependencies and encodes contextual information from the input. Prior work strives to attribute model decisions…

Computation and Language · Computer Science 2021-02-26 Yaru Hao , Li Dong , Furu Wei , Ke Xu

Reinforcement Learning (RL) heavily relies on the careful design of the reward function. However, accurately assigning rewards to each state-action pair in Long-Term Reinforcement Learning (LTRL) tasks remains a significant challenge. As a…

Machine Learning · Computer Science 2025-06-03 Qi Ju , Falin Hei , Zhemei Fang , Yunfeng Luo

In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A…

Learning long-term dependencies in extended temporal sequences requires credit assignment to events far back in the past. The most common method for training recurrent neural networks, back-propagation through time (BPTT), requires credit…

Machine Learning · Computer Science 2018-09-12 Nan Rosemary Ke , Anirudh Goyal , Olexa Bilaniuk , Jonathan Binas , Michael C. Mozer , Chris Pal , Yoshua Bengio

In the context of inverse reinforcement learning (IRL) with a single expert, adversarial inverse reinforcement learning (AIRL) serves as a foundational approach to providing comprehensive and transferable task descriptions. However, AIRL…

Machine Learning · Statistics 2024-12-31 Yangchun Zhang , Wang Zhou , Yirui Zhou

Traditionally, reinforcement learning (RL) agents learn to solve new tasks by updating their neural network parameters through interactions with the task environment. However, recent works demonstrate that some RL agents, after certain…

Machine Learning · Computer Science 2025-02-26 Jiuqi Wang , Ethan Blaser , Hadi Daneshmand , Shangtong Zhang

A significant challenge for the practical application of reinforcement learning in the real world is the need to specify an oracle reward function that correctly defines a task. Inverse reinforcement learning (IRL) seeks to avoid this…

Machine Learning · Computer Science 2019-10-16 Kelvin Xu , Ellis Ratner , Anca Dragan , Sergey Levine , Chelsea Finn

Style transfer deals with the algorithms to transfer the stylistic properties of a piece of text into that of another while ensuring that the core content is preserved. There has been a lot of interest in the field of text style transfer…

Computation and Language · Computer Science 2020-05-12 Abhilasha Sancheti , Kundan Krishna , Balaji Vasan Srinivasan , Anandhavelu Natarajan

Transfer learning has become the de facto standard in computer vision and natural language processing, especially where labeled data is scarce. Accuracy can be significantly improved by using pre-trained models and subsequent fine-tuning.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 T. S. Jayram , Vincent Marois , Tomasz Kornuta , Vincent Albouy , Emre Sevgen , Ahmet S. Ozcan

Reinforcement learning (RL) can be formulated as a sequence modeling problem, where models predict future actions based on historical state-action-reward sequences. Current approaches typically require long trajectory sequences to model the…

Machine Learning · Computer Science 2024-12-23 Hemant Kumawat , Saibal Mukhopadhyay