English
Related papers

Related papers: Characterizing the Action-Generalization Gap in De…

200 papers

Deep Reinforcement Learning (RL) has considerably advanced over the past decade. At the same time, state-of-the-art RL algorithms require a large computational budget in terms of training time to converge. Recent work has started to…

We introduce an approach for deep reinforcement learning (RL) that improves upon the efficiency, generalization capacity, and interpretability of conventional approaches through structured perception and relational reasoning. It uses…

Learning per-domain generalizing policies is a key challenge in learning for planning. Standard approaches learn state-value functions represented as graph neural networks using supervised learning on optimal plans generated by a teacher…

Artificial Intelligence · Computer Science 2026-03-19 Nicola J. Müller , Moritz Oster , Isabel Valera , Jörg Hoffmann , Timo P. Gros

In offline reinforcement learning (RL), one detrimental issue to policy learning is the error accumulation of deep Q function in out-of-distribution (OOD) areas. Unfortunately, existing offline RL methods are often over-conservative,…

Machine Learning · Computer Science 2023-03-02 Jianxiong Li , Xianyuan Zhan , Haoran Xu , Xiangyu Zhu , Jingjing Liu , Ya-Qin Zhang

Deep reinforcement learning (RL) has gained widespread adoption in recent years but faces significant challenges, particularly in unknown and complex environments. Among these, high-dimensional action selection stands out as a critical…

Machine Learning · Statistics 2025-07-08 Wenbo Zhang , Hengrui Cai

Deep reinforcement learning (RL) agents achieve impressive results in a wide variety of tasks, but they lack zero-shot adaptation capabilities. While most robustness evaluations focus on tasks complexifications, for which human also…

Next activity prediction aims to forecast the future behavior of running process instances. Recent publications in this field predominantly employ deep learning techniques and evaluate their prediction performance using publicly available…

Machine Learning · Computer Science 2023-09-19 Luka Abb , Peter Pfeiffer , Peter Fettke , Jana-Rebecca Rehse

In the past few years, deep reinforcement learning has been proven to solve problems which have complex states like video games or board games. The next step of intelligent agents would be able to generalize between tasks, and using prior…

Machine Learning · Computer Science 2018-09-05 Shu-Hsuan Hsu , I-Chao Shen , Bing-Yu Chen

Along with the rapid development of deep learning in practice, the theoretical explanations for its success become urgent. Generalization and expressivity are two widely used measurements to quantify theoretical behaviors of deep learning.…

Machine Learning · Computer Science 2018-03-26 Shao-Bo Lin

The offline reinforcement learning (RL) paradigm provides a general recipe to convert static behavior datasets into policies that can perform better than the policy that collected the data. While policy constraints, conservatism, and other…

Artificial Intelligence · Computer Science 2023-10-19 Jianlan Luo , Perry Dong , Jeffrey Wu , Aviral Kumar , Xinyang Geng , Sergey Levine

Generalist LLM agents are often post-trained on a narrow set of environments but deployed across far broader, unseen domains. In this work, we investigate the challenge of agentic post-training when the eventual test domains are unknown.…

Artificial Intelligence · Computer Science 2026-01-27 Zhihan Liu , Lin Guan , Yixin Nie , Kai Zhang , Zhuoqun Hao , Lin Chen , Asli Celikyilmaz , Zhaoran Wang , Na Zhang

This work introduces a neuro-symbolic agent that combines deep reinforcement learning (DRL) with temporal logic (TL) to achieve systematic zero-shot, i.e., never-seen-before, generalisation of formally specified instructions. In particular,…

Machine Learning · Computer Science 2021-09-14 Borja G. León , Murray Shanahan , Francesco Belardinelli

We propose Deep Q-Networks (DQN) with model-based exploration, an algorithm combining both model-free and model-based approaches that explores better and learns environments with sparse rewards more efficiently. DQN is a general-purpose,…

Machine Learning · Computer Science 2019-03-25 Stephen Zhen Gou , Yuyang Liu

Reinforcement learning (RL) is a dominant paradigm for training autonomous agents, yet these agents often exhibit poor generalization, failing to adapt to scenarios not seen during training. In this work, we identify a fundamental cause of…

Artificial Intelligence · Computer Science 2026-01-16 Jingyu Liu , Xiaopeng Wu , Jingquan Peng , Kehan Chen , Chuan Yu , Lizhong Ding , Yong Liu

Discrete-action algorithms have been central to numerous recent successes of deep reinforcement learning. However, applying these algorithms to high-dimensional action tasks requires tackling the combinatorial increase of the number of…

Machine Learning · Computer Science 2019-01-28 Arash Tavakoli , Fabio Pardo , Petar Kormushev

While reinforcement learning methods have delivered remarkable results in a number of settings, generalization, i.e., the ability to produce policies that generalize in a reliable and systematic way, has remained a challenge. The problem of…

Artificial Intelligence · Computer Science 2025-12-23 Simon Ståhlberg , Blai Bonet , Hector Geffner

Deep Reinforcement Learning has yielded proficient controllers for complex tasks. However, these controllers have limited memory and rely on being able to perceive the complete game screen at each decision point. To address these…

Machine Learning · Computer Science 2017-01-13 Matthew Hausknecht , Peter Stone

Financial trading has been widely analyzed for decades with market participants and academics always looking for advanced methods to improve trading performance. Deep reinforcement learning (DRL), a recently reinvigorated method with…

Trading and Market Microstructure · Quantitative Finance 2021-06-17 Ali Hirsa , Joerg Osterrieder , Branka Hadji-Misheva , Jan-Alexander Posth

In this work we propose a planning and acting architecture endowed with a module which learns to select subgoals with Deep Q-Learning. This allows us to decrease the load of a planner when faced with scenarios with real-time restrictions.…

Artificial Intelligence · Computer Science 2024-06-24 Carlos Núñez-Molina , Juan Fernández-Olivares , Raúl Pérez

We present a novel algorithm to train a deep Q-learning agent using natural-gradient techniques. We compare the original deep Q-network (DQN) algorithm to its natural-gradient counterpart, which we refer to as NGDQN, on a collection of…

Machine Learning · Computer Science 2018-11-15 Ethan Knight , Osher Lerner