English
Related papers

Related papers: Option Transfer and SMDP Abstraction with Successo…

200 papers

A challenge in multi-agent reinforcement learning is to be able to generalize over intractable state-action spaces. Inspired from Tesseract [Mahajan et al., 2021], this position paper investigates generalisation in state-action space over…

Machine Learning · Computer Science 2021-10-28 Pascal Van Der Vaart , Anuj Mahajan , Shimon Whiteson

Discovering useful temporal abstractions, in the form of options, is widely thought to be key to applying reinforcement learning and planning to increasingly complex domains. Building on the empirical success of the Expert Iteration…

Artificial Intelligence · Computer Science 2023-12-27 Kenny Young , Richard S. Sutton

In a world of proliferating data, the ability to rapidly summarize text is growing in importance. Automatic summarization of text can be thought of as a sequence to sequence problem. Another area of natural language processing that solves a…

Computation and Language · Computer Science 2018-10-23 Jacob Krantz , Jugal Kalita

Efficient exploration is a crucial challenge in deep reinforcement learning. Several methods, such as behavioral priors, are able to leverage offline data in order to efficiently accelerate reinforcement learning on complex tasks. However,…

Machine Learning · Computer Science 2022-09-01 Marco Bagatella , Sammy Christen , Otmar Hilliges

Two desiderata of reinforcement learning (RL) algorithms are the ability to learn from relatively little experience and the ability to learn policies that generalize to a range of problem specifications. In factored state spaces, one…

Artificial Intelligence · Computer Science 2025-08-19 Zizhao Wang , Caroline Wang , Xuesu Xiao , Yuke Zhu , Peter Stone

Transfer Learning has shown great potential to enhance single-agent Reinforcement Learning (RL) efficiency. Similarly, Multiagent RL (MARL) can also be accelerated if agents can share knowledge with each other. However, it remains a problem…

The ability to transfer in reinforcement learning is key towards building an agent of general artificial intelligence. In this paper, we consider the problem of learning to simultaneously transfer across both environments (ENV) and tasks…

Machine Learning · Computer Science 2021-05-28 Hexiang Hu , Liyu Chen , Boqing Gong , Fei Sha

Problems which require both long-horizon planning and continuous control capabilities pose significant challenges to existing reinforcement learning agents. In this paper we introduce a novel hierarchical reinforcement learning agent which…

Machine Learning · Computer Science 2023-07-25 Jan Achterhold , Markus Krimmel , Joerg Stueckler

We introduce a new approach for abstractive text summarization, Topic-Guided Abstractive Summarization, which calibrates long-range dependencies from topic-level features with globally salient content. The idea is to incorporate neural…

Computation and Language · Computer Science 2021-08-31 Chujie Zheng , Kunpeng Zhang , Harry Jiannan Wang , Ling Fan , Zhe Wang

This article introduces the theory of offline reinforcement learning in large state spaces, where good policies are learned from historical data without online interactions with the environment. Key concepts introduced include expressivity…

Machine Learning · Computer Science 2025-10-07 Nan Jiang , Tengyang Xie

Neural abstractions have been recently introduced as formal approximations of complex, nonlinear dynamical models. They comprise a neural ODE and a certified upper bound on the error between the abstract neural network and the concrete…

Logic in Computer Science · Computer Science 2023-10-03 Alec Edwards , Mirco Giacobbe , Alessandro Abate

Humans are adept at uncovering abstract associations in the world around them, yet the underlying mechanisms remain poorly understood. Intuitively, learning the higher-order structure of statistical relationships should involve complex…

Neurons and Cognition · Quantitative Biology 2020-03-26 Christopher W. Lynn , Ari E. Kahn , Nathaniel Nyema , Danielle S. Bassett

In this paper, we study the Tiered Reinforcement Learning setting, a parallel transfer learning framework, where the goal is to transfer knowledge from the low-tier (source) task to the high-tier (target) task to reduce the exploration risk…

Machine Learning · Computer Science 2024-06-14 Jiawei Huang , Niao He

The abstraction of dynamical systems is a powerful tool that enables the design of feedback controllers using a correct-by-design framework. We investigate a novel scheme to obtain data-driven abstractions of discrete-time stochastic…

Systems and Control · Electrical Eng. & Systems 2024-04-15 Rudi Coppola , Andrea Peruffo , Licio Romao , Alessandro Abate , Manuel Mazo

Efficient planning in continuous state and action spaces is fundamentally hard, even when the transition model is deterministic and known. One way to alleviate this challenge is to perform bilevel planning with abstractions, where a…

Artificial Intelligence · Computer Science 2025-05-28 Tom Silver , Rohan Chitnis , Nishanth Kumar , Willie McClinton , Tomas Lozano-Perez , Leslie Pack Kaelbling , Joshua Tenenbaum

We study the problem of representational transfer in RL, where an agent first pretrains in a number of source tasks to discover a shared representation, which is subsequently used to learn a good policy in a \emph{target task}. We propose a…

Machine Learning · Computer Science 2023-02-23 Alekh Agarwal , Yuda Song , Wen Sun , Kaiwen Wang , Mengdi Wang , Xuezhou Zhang

We study the problem of domain adaptation for neural abstractive summarization. We make initial efforts in investigating what information can be transferred to a new domain. Experimental results on news stories and opinion articles indicate…

Computation and Language · Computer Science 2017-07-25 Xinyu Hua , Lu Wang

This paper introduces an automated skill acquisition framework in reinforcement learning which involves identifying a hierarchical description of the given task in terms of abstract states and extended actions between abstract states.…

Machine Learning · Computer Science 2020-09-23 Aravind Srinivas , Ramnandan Krishnamurthy , Peeyush Kumar , Balaraman Ravindran

Enabling reinforcement learning (RL) agents to leverage a knowledge base while learning from experience promises to advance RL in knowledge intensive domains. However, it has proven difficult to leverage knowledge that is not manually…

Artificial Intelligence · Computer Science 2022-05-03 Niklas Höpner , Ilaria Tiddi , Herke van Hoof

Skills are temporal abstractions that are intended to improve reinforcement learning (RL) performance through hierarchical RL. Despite our intuition about the properties of an environment that make skills useful, a precise characterization…

Machine Learning · Computer Science 2024-06-13 Zhening Li , Gabriel Poesia , Armando Solar-Lezama