English
Related papers

Related papers: Learning Factored Markov Decision Processes with U…

200 papers

We propose a novel approach for planning agents to compose abstract skills via observing and learning from historical interactions with the world. Our framework operates in a Markov state-space model via a set of actions under unknown…

Artificial Intelligence · Computer Science 2022-07-19 Tin Lai

Learning from demonstrations has gained increasing interest in the recent past, enabling an agent to learn how to make decisions by observing an experienced teacher. While many approaches have been proposed to solve this problem, there is…

Machine Learning · Computer Science 2017-02-28 Jürgen Hahn , Abdelhak M. Zoubir

To quickly solve new tasks in complex environments, intelligent agents need to build up reusable knowledge. For example, a learned world model captures knowledge about the environment that applies to new tasks. Similarly, skills capture…

Machine Learning · Computer Science 2021-05-04 Kevin Xie , Homanga Bharadhwaj , Danijar Hafner , Animesh Garg , Florian Shkurti

Euclidean Markov decision processes are a powerful tool for modeling control problems under uncertainty over continuous domains. Finite state imprecise, Markov decision processes can be used to approximate the behavior of these infinite…

Artificial Intelligence · Computer Science 2020-06-29 Manfred Jaeger , Giorgio Bacci , Giovanni Bacci , Kim Guldstrand Larsen , Peter Gjøl Jensen

We formalize decision-making problems in robotics and automated control using continuous MDPs and actions that take place over continuous time intervals. We then approximate the continuous MDP using finer and finer discretizations. Doing…

Robotics · Computer Science 2020-05-22 Nan Rong , Joseph Y. Halpern , Ashutosh Saxena

We study episodic reinforcement learning in Markov decision processes when the agent receives additional feedback per step in the form of several transition observations. Such additional observations are available in a range of tasks…

Machine Learning · Computer Science 2020-05-11 Christoph Dann , Yishay Mansour , Mehryar Mohri , Ayush Sekhari , Karthik Sridharan

Meta-planning, or learning to guide planning from experience, is a promising approach to improving the computational cost of planning. A general meta-planning strategy is to learn to impose constraints on the states considered and actions…

Machine Learning · Computer Science 2020-11-10 Rohan Chitnis , Tom Silver , Beomjoon Kim , Leslie Pack Kaelbling , Tomas Lozano-Perez

This paper proposes a formal approach to online learning and planning for agents operating in a priori unknown, time-varying environments. The proposed method computes the maximally likely model of the environment, given the observations…

Machine Learning · Computer Science 2021-02-09 Melkior Ornik , Ufuk Topcu

In a variety of applications, an agent's success depends on the knowledge that an adversarial observer has or can gather about the agent's decisions. It is therefore desirable for the agent to achieve a task while reducing the ability of an…

Optimization and Control · Mathematics 2018-09-19 Mustafa O. Karabag , Melkior Ornik , Ufuk Topcu

Imitation learning enables autonomous agents to learn from human examples, without the need for a reward signal. Still, if the provided dataset does not encapsulate the task correctly, or when the task is too complex to be modeled, such…

Artificial Intelligence · Computer Science 2024-06-10 Federico Malato , Ville Hautamaki

Federated learning has emerged as an umbrella term for centralized coordination strategies in multi-agent environments. While many federated learning architectures process data in an online manner, and are hence adaptive by nature, most…

Machine Learning · Computer Science 2020-05-06 Elsa Rizk , Stefan Vlaski , Ali H. Sayed

Active perception strategies enable an agent to selectively gather information in a way to improve its performance. In applications in which the agent does not have prior knowledge about the available information sources, it is crucial to…

Artificial Intelligence · Computer Science 2019-10-08 Mahsa Ghasemi , Ufuk Topcu

We study the problem of decision-making in the setting of a scarcity of shared resources when the preferences of agents are unknown a priori and must be learned from data. Taking the two-sided matching market as a running example, we focus…

Computer Science and Game Theory · Computer Science 2021-11-24 Xiaowu Dai , Michael I. Jordan

Self-assessment rules play an essential role in safe and effective real-world robotic applications, which verify the feasibility of the selected action before actual execution. But how to utilize the self-assessment results to re-choose…

Robotics · Computer Science 2023-02-28 Kechun Xu , Runjian Chen , Shuqi Zhao , Zizhang Li , Hongxiang Yu , Ci Chen , Yue Wang , Rong Xiong

In the sequential decision making setting, an agent aims to achieve systematic generalization over a large, possibly infinite, set of environments. Such environments are modeled as discrete Markov decision processes with both states and…

Machine Learning · Computer Science 2023-03-31 Mirco Mutti , Riccardo De Santi , Emanuele Rossi , Juan Felipe Calderon , Michael Bronstein , Marcello Restelli

In this paper we consider the problem of how a reinforcement learning agent that is tasked with solving a sequence of reinforcement learning problems (a sequence of Markov decision processes) can use knowledge acquired early in its lifetime…

Machine Learning · Computer Science 2019-02-05 Francisco M. Garcia , Philip S. Thomas

Reinforcement learning has solid foundations, but becomes inefficient in partially observed (non-Markovian) environments. Thus, a learning agent -born with a representation and a policy- might wish to investigate to what extent the Markov…

Artificial Intelligence · Computer Science 2011-03-02 Gabor Matuz , Andras Lorincz

Learned dynamics models combined with both planning and policy learning algorithms have shown promise in enabling artificial agents to learn to perform many diverse tasks with limited supervision. However, one of the fundamental challenges…

Machine Learning · Computer Science 2020-08-12 Suraj Nair , Silvio Savarese , Chelsea Finn

When optimizing problems with uncertain parameter values in a linear objective, decision-focused learning enables end-to-end learning of these values. We are interested in a stochastic scheduling problem, in which processing times are…

Machine Learning · Computer Science 2024-08-16 Kim van den Houten , David M. J. Tax , Esteban Freydell , Mathijs de Weerdt

Reinforcement learning is commonly concerned with problems of maximizing accumulated rewards in Markov decision processes. Oftentimes, a certain goal state or a subset of the state space attain maximal reward. In such a case, the…

Artificial Intelligence · Computer Science 2024-08-23 Pavel Osinenko , Grigory Yaremenko , Georgiy Malaniya , Anton Bolychev , Alexander Gepperth