English
Related papers

Related papers: Auxiliary Reward Generation with Transition Distan…

200 papers

Reinforcement learning (RL) is a sub-domain of machine learning, mainly concerned with solving sequential decision-making problems by a learning agent that interacts with the decision environment to improve its behavior through the reward…

Machine Learning · Computer Science 2025-09-23 Hossein Hassani , Ehsan Hallaji , Roozbeh Razavi-Far , Mehrdad Saif , Liang Lin

We propose a Reinforcement Learning (RL) based control design framework for handling complex tasks. The approach extends the concept of Reward Machines (RM) with Signal Temporal Logic (STL) formulas that can be used for event generation.…

Artificial Intelligence · Computer Science 2026-04-17 Ana María Gómez Ruiz , Thao Dang , Alexandre Donzé

Deep reinforcement learning agents have achieved state-of-the-art results by directly maximising cumulative reward. However, environments contain a much wider variety of possible training signals. In this paper, we introduce an agent that…

Sequence generation with reinforcement learning (RL) has received significant attention recently. However, a challenge with such methods is the sparse-reward problem in the RL training process, in which a scalar guiding signal is often only…

Computation and Language · Computer Science 2018-11-05 Ruiyi Zhang , Changyou Chen , Zhe Gan , Wenlin Wang , Liqun Chen , Dinghan Shen , Guoyin Wang , Lawrence Carin

In Reinforcement Learning (RL), Laplacian Representation (LapRep) is a task-agnostic state representation that encodes the geometry of the environment. A desirable property of LapRep stated in prior works is that the Euclidean distance in…

Machine Learning · Computer Science 2022-10-25 Kaixin Wang , Kuangqi Zhou , Jiashi Feng , Bryan Hooi , Xinchao Wang

Multi-task representation learning (MTRL) is an approach that learns shared latent representations across related tasks, facilitating collaborative learning that improves the overall learning efficiency. This paper studies MTRL for…

Machine Learning · Computer Science 2026-04-07 Yaoze Guo , Shana Moothedath

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

Software Engineering · Computer Science 2025-10-08 Yu Zhu

Reinforcement learning (RL) has experienced a second wind in the past decade. While incredibly successful in images and videos, these systems still operate within the realm of propositional tasks ignoring the inherent structure that exists…

Machine Learning · Computer Science 2025-10-21 Fateme Golivand Darvishvand , Hikaru Shindo , Sahil Sidheekh , Kristian Kersting , Sriraam Natarajan

Model-based reinforcement learning (RL) is more sample efficient than model-free RL by using imaginary trajectories generated by the learned dynamics model. When the model is inaccurate or biased, imaginary trajectories may be deleterious…

Machine Learning · Computer Science 2021-04-12 Wenzhen Huang , Qiyue Yin , Junge Zhang , Kaiqi Huang

Reinforcement learning (RL) relies heavily on exploration to learn from its environment and maximize observed rewards. Therefore, it is essential to design a reward function that guarantees optimal learning from the received experience.…

Artificial Intelligence · Computer Science 2022-06-20 Ingy ElSayed-Aly , Lu Feng

Reward machines are automaton-like structures that capture the memory required to accomplish a multi-stage task. When combined with reinforcement learning or optimal control methods, they can be used to synthesize robot policies to achieve…

Robotics · Computer Science 2026-04-10 Mohamad Louai Shehab , Antoine Aspeel , Necmiye Ozay

Long-form generation has become a critical and challenging application for Large Language Models (LLMs). Existing studies are limited by their reliance on scarce, high-quality long-form response data and their focus on coarse-grained,…

Computation and Language · Computer Science 2026-01-01 Jianghao Chen , Wei Sun , Qixiang Yin , Zhixing Tan , Jiajun Zhang

In reinforcement learning (RL), sparse rewards are a natural way to specify the task to be learned. However, most RL algorithms struggle to learn in this setting since the learning signal is mostly zeros. In contrast, humans are good at…

In reinforcement learning (RL), state representations are key to dealing with large or continuous state spaces. While one of the promises of deep learning algorithms is to automatically construct features well-tuned for the task they try to…

Machine Learning · Computer Science 2023-06-21 Charline Le Lan , Stephen Tu , Mark Rowland , Anna Harutyunyan , Rishabh Agarwal , Marc G. Bellemare , Will Dabney

A model used for velocity control during car following was proposed based on deep reinforcement learning (RL). To fulfil the multi-objectives of car following, a reward function reflecting driving safety, efficiency, and comfort was…

Machine Learning · Computer Science 2020-07-14 Meixin Zhu , Yinhai Wang , Ziyuan Pu , Jingyun Hu , Xuesong Wang , Ruimin Ke

Reward design remains a significant bottleneck in applying reinforcement learning (RL) to real-world problems. A popular alternative is reward learning, where reward functions are inferred from human feedback rather than manually specified.…

Machine Learning · Computer Science 2026-01-16 Chaitanya Kharyal , Calarina Muslimani , Matthew E. Taylor

Many real-world reinforcement learning (RL) problems necessitate learning complex, temporally extended behavior that may only receive reward signal when the behavior is completed. If the reward-worthy behavior is known, it can be specified…

Machine Learning · Computer Science 2023-01-10 Phillip J. K. Christoffersen , Andrew C. Li , Rodrigo Toro Icarte , Sheila A. McIlraith

A key challenge in reinforcement learning (RL) is reward (mis)specification, whereby imprecisely defined reward functions can result in unintended, possibly harmful, behaviours. Indeed, reward functions in RL are typically treated as…

Machine Learning · Computer Science 2025-10-22 Daniel Donnelly , Angelo Ferrando , Francesco Belardinelli

Inverse reinforcement learning (IRL) infers a reward function from demonstrations, allowing for policy improvement and generalization. However, despite much recent interest in IRL, little work has been done to understand the minimum set of…

Machine Learning · Computer Science 2019-08-19 Daniel S. Brown , Scott Niekum

Many real-world applications require an agent to make robust and deliberate decisions with multimodal information (e.g., robots with multi-sensory inputs). However, it is very challenging to train the agent via reinforcement learning (RL)…

Machine Learning · Computer Science 2023-02-21 Jinming Ma , Feng Wu , Yingfeng Chen , Xianpeng Ji , Yu Ding