English
Related papers

Related papers: Efficient, Safe, and Probably Approximately Comple…

200 papers

Learned dynamics models combined with both planning and policy learning algorithms have shown promise in enabling artificial agents to learn to perform many diverse tasks with limited supervision. However, one of the fundamental challenges…

Machine Learning · Computer Science 2020-08-12 Suraj Nair , Silvio Savarese , Chelsea Finn

A "model" is a theory that describes the state of an environment and the effects of an agent's decisions on the environment. A model-based agent can use its model to predict the effects of its future actions and so plan ahead, but must know…

Artificial Intelligence · Computer Science 2025-07-23 Stassa Patsantzis

A precondition for the deployment of a Reinforcement Learning agent to a real-world system is to provide guarantees on the learning process. While a learning algorithm will eventually converge to a good policy, there are no guarantees on…

Machine Learning · Statistics 2023-12-27 Paul Daoudi , Mathias Formoso , Othman Gaizi , Achraf Azize , Evrard Garcelon

When environmental interaction is expensive, model-based reinforcement learning offers a solution by planning ahead and avoiding costly mistakes. Model-based agents typically learn a single-step transition model. In this paper, we propose a…

Machine Learning · Computer Science 2018-11-02 Kavosh Asadi , Evan Cater , Dipendra Misra , Michael L. Littman

A long-standing challenge in Reinforcement Learning is enabling agents to learn a model of their environment which can be transferred to solve other problems in a world with the same underlying rules. One reason this is difficult is the…

Machine Learning · Computer Science 2019-05-16 Kai Olav Ellefsen , Jim Torresen

As artificial agents become increasingly capable, what internal structure is *necessary* for an agent to act competently under uncertainty? Classical results show that optimal control can be *implemented* using belief states or world…

Machine Learning · Computer Science 2026-04-03 Aran Nayebi

Safe reinforcement learning is a promising path toward applying reinforcement learning algorithms to real-world problems, where suboptimal behaviors may lead to actual negative consequences. In this work, we focus on the setting where…

Machine Learning · Computer Science 2022-02-17 Garrett Thomas , Yuping Luo , Tengyu Ma

In the sequential decision making setting, an agent aims to achieve systematic generalization over a large, possibly infinite, set of environments. Such environments are modeled as discrete Markov decision processes with both states and…

Machine Learning · Computer Science 2023-03-31 Mirco Mutti , Riccardo De Santi , Emanuele Rossi , Juan Felipe Calderon , Michael Bronstein , Marcello Restelli

We propose a novel approach for planning agents to compose abstract skills via observing and learning from historical interactions with the world. Our framework operates in a Markov state-space model via a set of actions under unknown…

Artificial Intelligence · Computer Science 2022-07-19 Tin Lai

In dynamic epistemic logic, actions are described using action models. In this paper we introduce a framework for studying learnability of action models from observations. We present first results concerning propositional action models.…

Machine Learning · Computer Science 2015-07-16 Thomas Bolander , Nina Gierasimczuk

When learning to act in a stochastic, partially observable environment, an intelligent agent should be prepared to anticipate a change in its belief of the environment state, and be capable of adapting its actions on-the-fly to changing…

Machine Learning · Computer Science 2022-04-14 Ugo Lecerf , Christelle Yemdji-Tchassi , Pietro Michiardi

Model-Based Reinforcement Learning involves learning a \textit{dynamics model} from data, and then using this model to optimise behaviour, most often with an online \textit{planner}. Much of the recent research along these lines presents a…

Modern cyber-physical systems are becoming increasingly complex to model, thus motivating data-driven techniques such as reinforcement learning (RL) to find appropriate control agents. However, most systems are subject to hard constraints…

We present a new abductive, probabilistic theory of plan recognition. This model differs from previous plan recognition theories in being centered around a model of plan execution: most previous methods have been based on plans as formal…

Artificial Intelligence · Computer Science 2013-01-30 Robert P. Goldman , Christopher W. Geib , Christopher A. Miller

We study the problem of exploration in Reinforcement Learning and present a novel model-free solution. We adopt an information-theoretical viewpoint and start from the instance-specific lower bound of the number of samples that have to be…

Machine Learning · Computer Science 2024-07-02 Alessio Russo , Alexandre Proutiere

Decision-theoretic planning with risk-sensitive planning objectives is important for building autonomous agents or decision-support systems for real-world applications. However, this line of research has been largely ignored in the…

Artificial Intelligence · Computer Science 2012-07-09 Yaxin Liu , Sven Koenig

We consider the problem of security-aware planning in an unknown stochastic environment, in the presence of attacks on control signals (i.e., actuators) of the robot. We model the attacker as an agent who has the full knowledge of the…

Robotics · Computer Science 2026-04-07 Alper Kamil Bozkurt , Yu Wang , Miroslav Pajic

In the last decade, reinforcement learning successfully solved complex control tasks and decision-making problems, like the Go board game. Yet, there are few success stories when it comes to deploying those algorithms to real-world…

Artificial Intelligence · Computer Science 2024-09-13 Giuseppe Paolo , Jonas Gonzalez-Billandon , Albert Thomas , Balázs Kégl

Training a model-free reinforcement learning agent requires allowing the agent to sufficiently explore the environment to search for an optimal policy. In safety-constrained environments, utilizing unsupervised exploration or a non-optimal…

Artificial Intelligence · Computer Science 2024-08-05 Erfan Entezami , Mahsa Sahebdel , Dhawal Gupta

Although recent model-free reinforcement learning algorithms have been shown to be capable of mastering complicated decision-making tasks, the sample complexity of these methods has remained a hurdle to utilizing them in many real-world…

Machine Learning · Computer Science 2020-04-21 Saeed Moazami , Peggy Doerschuk