English
Related papers

Related papers: Tabular and Deep Reinforcement Learning for Gittin…

200 papers

Action-constrained reinforcement learning (RL) is a widely-used approach in various real-world applications, such as scheduling in networked systems with resource constraints and control of a robot with kinematic constraints. While the…

Machine Learning · Computer Science 2021-08-03 Jyun-Li Lin , Wei Hung , Shang-Hsuan Yang , Ping-Chun Hsieh , Xi Liu

Restless multi-armed bandits (RMAB) have been widely used to model sequential decision making problems with constraints. The decision maker (DM) aims to maximize the expected total reward over an infinite horizon under an "instantaneous…

Machine Learning · Computer Science 2023-12-25 Shufan Wang , Guojun Xiong , Jian Li

We study the problem of training a risk-sensitive reinforcement learning (RL) agent through imitation learning (IL). Unlike standard IL, our goal is not only to train an agent that matches the expert's expected return (i.e., its average…

Machine Learning · Computer Science 2025-09-16 Filippo Lazzati , Alberto Maria Metelli

Reinforcement Learning (RL) is increasingly applied to large-scale decision-making problems like logistics, scheduling, and recommender systems, but existing algorithms struggle with the curse of dimensionality in such large discrete action…

Machine Learning · Computer Science 2026-05-12 Heiko Hoppe , Fabian Akkerman , Wouter van Heeswijk , Maximilian Schiffer

The multi-armed bandit problem is a core framework for sequential decision-making under uncertainty, but classical algorithms often fail in environments with hidden, time-varying states that confound reward estimation and optimal action…

Machine Learning · Computer Science 2026-02-19 Jikai Jin , Kenneth Hung , Sanath Kumar Krishnamurthy , Baoyi Shi , Congshan Zhang

In recent years significant progress has been made in dealing with challenging problems using reinforcement learning.Despite its great success, reinforcement learning still faces challenge in continuous control tasks. Conventional methods…

Machine Learning · Computer Science 2020-02-04 Longxiang Shi , Shijian Li , Longbing Cao , Long Yang , Gang Zheng , Gang Pan

We propose a policy improvement algorithm for Reinforcement Learning (RL) which is called Rerouted Behavior Improvement (RBI). RBI is designed to take into account the evaluation errors of the Q-function. Such errors are common in RL when…

Machine Learning · Computer Science 2019-07-12 Elad Sarafian , Aviv Tamar , Sarit Kraus

Interpretability of AI models allows for user safety checks to build trust in such AIs. In particular, Decision Trees (DTs) provide a global look at the learned model and transparently reveal which features of the input are critical for…

Machine Learning · Computer Science 2024-01-23 Hector Kohler , Riad Akrour , Philippe Preux

While numerous works have focused on devising efficient algorithms for reinforcement learning (RL) with uniformly bounded rewards, it remains an open question whether sample or time-efficient algorithms for RL with large state-action space…

Machine Learning · Computer Science 2024-03-08 Jiayi Huang , Han Zhong , Liwei Wang , Lin F. Yang

In this paper, a deep reinforcement learning (DRL)-based approach to the Lyapunov optimization is considered to minimize the time-average penalty while maintaining queue stability. A proper construction of state and action spaces is…

Networking and Internet Architecture · Computer Science 2020-12-16 Sohee Bae , Seungyul Han , Youngchul Sung

While researchers in the asset management industry have mostly focused on techniques based on financial and risk planning techniques like Markowitz efficient frontier, minimum variance, maximum diversification or equal risk parity, in…

Machine Learning · Computer Science 2020-10-20 Eric Benhamou , David Saltiel , Sandrine Ungari , Abhishek Mukhopadhyay

Traditional power grid systems have become obsolete under more frequent and extreme natural disasters. Reinforcement learning (RL) has been a promising solution for resilience given its successful history of power grid control. However,…

Machine Learning · Computer Science 2022-12-09 Zhenting Zhao , Po-Yen Chen , Yucheng Jin

Three major challenges in reinforcement learning are the complex dynamical systems with large state spaces, the costly data acquisition processes, and the deviation of real-world dynamics from the training environment deployment. To…

Machine Learning · Computer Science 2024-06-04 Shyam Sundhar Ramesh , Pier Giuseppe Sessa , Yifan Hu , Andreas Krause , Ilija Bogunovic

This paper proposes an exploration-efficient Deep Reinforcement Learning with Reference policy (DRLR) framework for learning robotics tasks that incorporates demonstrations. The DRLR framework is developed based on an algorithm called…

Robotics · Computer Science 2026-01-09 Chengyandan Shen , Christoffer Sloth

Whittle index policy is a powerful tool to obtain asymptotically optimal solutions for the notoriously intractable problem of restless bandits. However, finding the Whittle indices remains a difficult problem for many practical restless…

Machine Learning · Computer Science 2022-01-21 Khaled Nakhleh , Santosh Ganji , Ping-Chun Hsieh , I-Hong Hou , Srinivas Shakkottai

The inverse reinforcement learning approach to imitation learning is a double-edged sword. On the one hand, it can enable learning from a smaller number of expert demonstrations with more robustness to error compounding than behavioral…

Machine Learning · Computer Science 2024-06-06 Juntao Ren , Gokul Swamy , Zhiwei Steven Wu , J. Andrew Bagnell , Sanjiban Choudhury

The knowledge gradient (KG) algorithm is a popular and effective algorithm for the best arm identification (BAI) problem. Due to the complex calculation of KG, theoretical analysis of this algorithm is difficult, and existing results are…

Machine Learning · Statistics 2022-11-23 Yanwen Li , Siyang Gao

We study how a central bank should dynamically set short-term nominal interest rates to stabilize inflation and unemployment when macroeconomic relationships are uncertain and time-varying. We model monetary policy as a sequential…

Statistical Finance · Quantitative Finance 2026-01-06 Tony Wang , Kyle Feinstein , Sheryl Chen

Information theoretic sensor management approaches are an ideal solution to state estimation problems when considering the optimal control of multi-agent systems, however they are too computationally intensive for large state spaces,…

Multiagent Systems · Computer Science 2021-02-02 William A. Dawson , Ruben Glatt , Edward Rusu , Braden C. Soper , Ryan A. Goldhahn

In this paper, we study the optimal dividend problem under the continuous time diffusion model with the bounded dividend rate from the Reinforcement Learning (RL) perspective. Unlike the standard literature, our main focus will be on…

Optimization and Control · Mathematics 2026-03-30 Lihua Bai , Thejani Gamage , Jin Ma , Gaozhan Wang