English
Related papers

Related papers: Identifying Critical States by the Action-Based Va…

200 papers

Growing concerns regarding the operational usage of AI models in the real-world has caused a surge of interest in explaining AI models' decisions to humans. Reinforcement Learning is not an exception in this regard. In this work, we propose…

Machine Learning · Computer Science 2023-10-06 Omid Davoodi , Majid Komeili

In many reinforcement learning (RL) problems, it takes some time until a taken action by the agent reaches its maximum effect on the environment and consequently the agent receives the reward corresponding to that action by a delay called…

Machine Learning · Computer Science 2020-10-30 Hamid Radmard Rahmani , Carsten Koenke , Marco A. Wiering

In Reinforcement Learning-based Recommender Systems (RLRS), the complexity and dynamism of user interactions often result in high-dimensional and noisy state spaces, making it challenging to discern which aspects of the state are truly…

Artificial Intelligence · Computer Science 2024-07-19 Siyu Wang , Xiaocong Chen , Lina Yao

Standard model-free deep reinforcement learning (RL) algorithms sample a new initial state for each trial, allowing them to optimize policies that can perform well even in highly stochastic environments. However, problems that exhibit…

Machine Learning · Computer Science 2018-04-30 Dibya Ghosh , Avi Singh , Aravind Rajeswaran , Vikash Kumar , Sergey Levine

We study the exploration problem in episodic MDPs with rich observations generated from a small number of latent states. Under certain identifiability assumptions, we demonstrate how to estimate a mapping from the observations to latent…

Machine Learning · Computer Science 2021-09-10 Simon S. Du , Akshay Krishnamurthy , Nan Jiang , Alekh Agarwal , Miroslav Dudík , John Langford

Efficient exploration is a crucial challenge in deep reinforcement learning. Several methods, such as behavioral priors, are able to leverage offline data in order to efficiently accelerate reinforcement learning on complex tasks. However,…

Machine Learning · Computer Science 2022-09-01 Marco Bagatella , Sammy Christen , Otmar Hilliges

When decisions are made at high frequency, traditional reinforcement learning (RL) methods struggle to accurately estimate action values. In turn, their performance is inconsistent and often poor. Whether the performance of distributional…

Machine Learning · Computer Science 2024-10-16 Harley Wiltzer , Marc G. Bellemare , David Meger , Patrick Shafto , Yash Jhaveri

The capability to widely sample the state and action spaces is a key ingredient toward building effective reinforcement learning algorithms. The variational optimization principles exposed in this paper emphasize the importance of an…

Machine Learning · Computer Science 2022-05-25 Emmanuel Daucé

Action selection based on flags is a Reinforcement Learning (RL) exploration policy that improves the exploration of the state space through the use of flags, which can identify the most promising actions to take in each state. The quantum…

Machine Learning · Computer Science 2025-05-09 Filipe Santos , João Paulo Fernandes , Luís Macedo

Building trust in reinforcement learning (RL) agents requires understanding why they make certain decisions, especially in high-stakes applications like robotics, healthcare, and finance. Existing explainability methods often focus on…

Artificial Intelligence · Computer Science 2025-06-18 Rishav Rishav , Somjit Nath , Vincent Michalski , Samira Ebrahimi Kahou

Distributional reinforcement learning (RL) -- in which agents learn about all the possible long-term consequences of their actions, and not just the expected value -- is of great recent interest. One of the most important affordances of a…

Artificial Intelligence · Computer Science 2021-11-15 Chris Gagne , Peter Dayan

Machine Learning models become increasingly proficient in complex tasks. However, even for experts in the field, it can be difficult to understand what the model learned. This hampers trust and acceptance, and it obstructs the possibility…

Machine Learning · Computer Science 2018-07-24 Jasper van der Waa , Jurriaan van Diggelen , Karel van den Bosch , Mark Neerincx

Reinforcement learning (RL) and Deep Reinforcement Learning (DRL), in particular, have the potential to disrupt and are already changing the way we interact with the world. One of the key indicators of their applicability is their ability…

Machine Learning · Computer Science 2024-08-20 Nikolai Rozanov

Deep reinforcement learning (DRL) breaks through the bottlenecks of traditional reinforcement learning (RL) with the help of the perception capability of deep learning and has been widely applied in real-world problems.While model-free RL,…

Machine Learning · Computer Science 2022-11-28 Tingting Zhao , Ying Wang , Wei Sun , Yarui Chen , Gang Niub , Masashi Sugiyama

Model-free Reinforcement Learning (RL) generally suffers from poor sample complexity, mostly due to the need to exhaustively explore the state-action space to find well-performing policies. On the other hand, we postulate that expert…

Machine Learning · Computer Science 2023-09-13 Loris Di Natale , Bratislav Svetozarevic , Philipp Heer , Colin N. Jones

Online reinforcement learning (RL) with complex function approximations such as transformers and deep neural networks plays a significant role in the modern practice of artificial intelligence. Despite its popularity and importance,…

Machine Learning · Computer Science 2025-06-30 Tong Yang , Bo Dai , Lin Xiao , Yuejie Chi

Reinforcement learning (RL) has emerged as a powerful method for improving the reasoning abilities of large language models (LLMs). Outcome-based RL, which rewards policies solely for the correctness of the final answer, yields substantial…

Machine Learning · Computer Science 2025-09-09 Yuda Song , Julia Kempe , Remi Munos

Optimizing objective functions subject to constraints is fundamental in many real-world applications. However, these constraints are often not readily defined and must be inferred from expert agent behaviors, a problem known as Inverse…

Machine Learning · Computer Science 2025-05-19 Bo Yue , Jian Li , Guiliang Liu

Online matching problems arise in many complex systems, from cloud services and online marketplaces to organ exchange networks, where timely, principled decisions are critical for maintaining high system performance. Traditional heuristics…

Machine Learning · Statistics 2025-10-09 Chiara Mignacco , Matthieu Jonckheere , Gilles Stoltz

Planning methods can solve temporally extended sequential decision making problems by composing simple behaviors. However, planning requires suitable abstractions for the states and transitions, which typically need to be designed by hand.…

Machine Learning · Computer Science 2019-11-20 Soroush Nasiriany , Vitchyr H. Pong , Steven Lin , Sergey Levine