English
Related papers

Related papers: Non-Deterministic Policies in Markovian Decision P…

200 papers

In many real-world problems, there is the possibility to configure, to a limited extent, some environmental parameters to improve the performance of a learning agent. In this paper, we propose a novel framework, Configurable Markov Decision…

Artificial Intelligence · Computer Science 2018-06-15 Alberto Maria Metelli , Mirco Mutti , Marcello Restelli

This paper investigates methods for estimating the optimal stochastic control policy for a Markov Decision Process with unknown transition dynamics and an unknown reward function. This form of model-free reinforcement learning comprises…

Machine Learning · Computer Science 2019-12-06 Brandon Trabucco , Albert Qu , Simon Li , Ganeshkumar Ashokavardhanan

The Markov decision process (MDP) formulation used to model many real-world sequential decision making problems does not efficiently capture the setting where the set of available decisions (actions) at each time step is stochastic.…

Machine Learning · Computer Science 2020-01-22 Yash Chandak , Georgios Theocharous , Blossom Metevier , Philip S. Thomas

In this paper, we study planning in stochastic systems, modeled as Markov decision processes (MDPs), with preferences over temporally extended goals. Prior work on temporal planning with preferences assumes that the user preferences form a…

Robotics · Computer Science 2023-03-09 Hazhar Rahmani , Abhishek N. Kulkarni , Jie Fu

Training automated agents to complete complex tasks in interactive environments is challenging: reinforcement learning requires careful hand-engineering of reward functions, imitation learning requires specialized infrastructure and access…

Machine Learning · Computer Science 2023-02-21 Olivia Watkins , Trevor Darrell , Pieter Abbeel , Jacob Andreas , Abhishek Gupta

Devising optimal interventions for constraining stochastic systems is a challenging endeavour that has to confront the interplay between randomness and nonlinearity. Existing methods for identifying the necessary dynamical adjustments…

Statistical Mechanics · Physics 2022-10-18 Dimitra Maoutsa , Manfred Opper

We propose a method to teach an automated agent to learn how to search for multi-hop paths of relations between entities in an open domain. The method learns a policy for directing existing information retrieval and machine reading…

Computation and Language · Computer Science 2022-05-31 Enrique Noriega-Atala , Mihai Surdeanu , Clayton T. Morrison

We consider reinforcement learning in changing Markov Decision Processes where both the state-transition probabilities and the reward functions may vary over time. For this problem setting, we propose an algorithm using a sliding window…

Machine Learning · Computer Science 2018-05-28 Pratik Gajane , Ronald Ortner , Peter Auer

Predicting the outcomes of cyber-physical systems with multiple human interactions is a challenging problem. This article reviews a game theoretical approach to address this issue, where reinforcement learning is employed to predict the…

Multiagent Systems · Computer Science 2019-10-14 Mert Albaba , Yildiray Yildiz

Reinforcement learning agents can learn to solve sequential decision tasks by interacting with the environment. Human knowledge of how to solve these tasks can be incorporated using imitation learning, where the agent learns to imitate…

Artificial Intelligence · Computer Science 2019-09-24 Ruohan Zhang , Faraz Torabi , Lin Guan , Dana H. Ballard , Peter Stone

Reinforcement learning algorithms are typically designed for generic Markov Decision Processes (MDPs), where any state-action pair can lead to an arbitrary transition distribution. In many practical systems, however, only a subset of the…

Machine Learning · Computer Science 2026-03-05 Davide Maran , Davide Salaorni , Marcello Restelli

Interactive reinforcement learning agents use human feedback or instruction to help them learn in complex environments. Often, this feedback comes in the form of a discrete signal that is either positive or negative. While informative, this…

Artificial Intelligence · Computer Science 2021-04-13 Tasmia Tasrin , Md Sultan Al Nahian , Habarakadage Perera , Brent Harrison

In this article, we discuss two algorithms tailored to discrete-time deterministic finite-horizon nonlinear optimal control problems or so-called deterministic trajectory optimization problems. Both algorithms can be derived from an…

Optimization and Control · Mathematics 2024-12-10 Mohammad Mahmoudi Filabadi , Tom Lefebvre , Guillaume Crevecoeur

The significance of network structures in promoting group cooperation within social dilemmas has been widely recognized. Prior studies attribute this facilitation to the assortment of strategies driven by spatial interactions. Although…

Multiagent Systems · Computer Science 2024-08-20 Tianyu Ren , Xiao-Jun Zeng

Recent success in developing increasingly general purpose agents based on sequence models has led to increased focus on the problem of deploying computationally limited agents within the vastly more complex real-world. A key challenge…

Machine Learning · Computer Science 2025-12-23 Geraud Nangue Tasse , Matthew Riemer , Benjamin Rosman , Tim Klinger

Modeling user sequential behaviors has recently attracted increasing attention in the recommendation domain. Existing methods mostly assume coherent preference in the same sequence. However, user personalities are volatile and easily…

Information Retrieval · Computer Science 2022-04-01 Weiqi Shao , Xu Chen , Long Xia , Jiashu Zhao , Dawei Yin

Algorithmic recourse seeks to provide individuals with actionable recommendations that increase their chances of receiving favorable outcomes from automated decision systems (e.g., loan approvals). While prior research has emphasized…

Machine Learning · Computer Science 2026-02-03 Marina Ceccon , Alessandro Fabris , Goran Radanović , Asia J. Biega , Gian Antonio Susto

The control of nonlinear dynamical systems remains a major challenge for autonomous agents. Current trends in reinforcement learning (RL) focus on complex representations of dynamics and policies, which have yielded impressive results in…

Machine Learning · Computer Science 2020-05-13 Hany Abdulsamad , Jan Peters

Traditional reinforcement learning usually assumes either episodic interactions with resets or continuous operation to minimize average or cumulative loss. While episodic settings have many theoretical results, resets are often unrealistic…

Optimization and Control · Mathematics 2026-01-13 Bianca Marin Moreno , Margaux Brégère , Pierre Gaillard , Nadia Oudjane

A fundamental (and largely open) challenge in sequential decision-making is dealing with non-stationary environments, where exogenous environmental conditions change over time. Such problems are traditionally modeled as non-stationary…

Artificial Intelligence · Computer Science 2024-01-23 Baiting Luo , Yunuo Zhang , Abhishek Dubey , Ayan Mukhopadhyay