English
Related papers

Related papers: COOL-MC: Verifying and Explaining RL Policies for …

200 papers

Recent advances in reinforcement learning (RL) enable its use on increasingly complex tasks, but the lack of formal safety guarantees still limits its application in safety-critical settings. A common practical approach is to augment the RL…

Machine Learning · Computer Science 2026-02-12 Donggeon David Oh , Duy P. Nguyen , Haimin Hu , Jaime F. Fisac

Partial observability is a notorious challenge in reinforcement learning (RL), due to the need to learn complex, history-dependent policies. Recent empirical successes have used privileged expert distillation--which leverages availability…

Machine Learning · Computer Science 2025-10-06 Yuda Song , Dhruv Rohatgi , Aarti Singh , J. Andrew Bagnell

Imagine a patient in critical condition. What and when should be measured to forecast detrimental events, especially under the budget constraints? We answer this question by deep reinforcement learning (RL) that jointly minimizes the…

Machine Learning · Computer Science 2019-06-11 Chun-Hao Chang , Mingjie Mai , Anna Goldenberg

This paper describes the application of reinforcement learning (RL) to multi-product inventory management in supply chains. The problem description and solution are both adapted from a real-world business solution. The novelty of this…

Machine Learning · Computer Science 2020-06-09 Nazneen N Sultana , Hardik Meisheri , Vinita Baniwal , Somjit Nath , Balaraman Ravindran , Harshad Khadilkar

Although safety stock optimisation has been studied for more than 60 years, most companies still use simplistic means to calculate necessary safety stock levels, partly due to the mismatch between existing analytical methods' emphases on…

Multiagent Systems · Computer Science 2021-07-05 Edward Elson Kosasih , Alexandra Brintrup

We consider the problem of optimal control of district cooling energy plants (DCEPs) consisting of multiple chillers, a cooling tower, and a thermal energy storage (TES), in the presence of time-varying electricity price. A straightforward…

Systems and Control · Electrical Eng. & Systems 2023-10-09 Zhong Guo , Aditya Chaudhari , Austin R. Coffman , Prabir Barooah

Markov decision processes (MDPs) are the defacto frame-work for sequential decision making in the presence ofstochastic uncertainty. A classical optimization criterion forMDPs is to maximize the expected discounted-sum pay-off, which…

Artificial Intelligence · Computer Science 2020-02-28 Tomas Brazdil , Krishnendu Chatterjee , Petr Novotny , Jiri Vahala

Order picking is a pivotal operation in warehouses that directly impacts overall efficiency and profitability. This study addresses the dynamic order picking problem, a significant concern in modern warehouse management, where real-time…

Optimization and Control · Mathematics 2025-04-08 Sasan Mahmoudinazlou , Abhay Sobhanan , Hadi Charkhgard , Ali Eshragh , George Dunn

Continual Reinforcement Learning (CRL) aims to develop lifelong learning agents to continuously acquire knowledge across diverse tasks while mitigating catastrophic forgetting. This requires efficiently managing the stability-plasticity…

Machine Learning · Computer Science 2026-02-02 Yuxuan Li , Qijun He , Mingqi Yuan , Wen-Tse Chen , Jeff Schneider , Jiayu Chen

We propose a new policy, called the LP-update policy, to solve finite horizon weakly-coupled Markov decision processes. The latter can be seen as multi-constraint multi-action bandits, and generalize the classical restless bandit problems.…

Optimization and Control · Mathematics 2024-05-08 Nicolas Gast , Bruno Gaujal , Chen Yan

Rollout approaches are an effective tool to address the problem of co-designing the transmission schedule and the corresponding input values, when the controller is connected to the plant via a resource-constrained communication network.…

Systems and Control · Electrical Eng. & Systems 2020-02-12 Stefan Wildhagen , Frank Allgöwer

In the last decade, Reinforcement Learning (RL) has achieved remarkable success in the control and decision-making of complex dynamical systems. However, most RL algorithms rely on the Markov Decision Process assumption, which is violated…

Machine Learning · Statistics 2026-02-03 Armando Alves Neto

Contact-rich micromanipulation in microfluidic flow is challenging because small disturbances can break pushing contact and induce large lateral drift. We study planar cell pushing with a magnetic rolling microrobot that tracks a…

Robotics · Computer Science 2026-03-06 Yanda Yang , Sambeeta Das

Reinforcement learning (RL) and model predictive control (MPC) offer a wealth of distinct approaches for automatic decision-making under uncertainty. Given the impact both fields have had independently across numerous domains, there is…

Systems and Control · Electrical Eng. & Systems 2025-10-13 Nathan P. Lawrence , Philip D. Loewen , Michael G. Forbes , R. Bhushan Gopaluni , Ali Mesbah

Closed-loop management of geological CO2 storage requires control policies that adapt to uncertain reservoir behavior while relying on observations that are realistically available during operation. This work formulates CO2 injection and…

Machine Learning · Computer Science 2026-05-05 Sofianos Panagiotis Fotias , Vassilis Gaganis

Hyperproperties have shown to be a powerful tool for expressing and reasoning about information-flow security policies. In this paper, we investigate the problem of statistical model checking (SMC) for hyperproperties. Unlike exhaustive…

Logic in Computer Science · Computer Science 2020-08-06 Yu Wang , Siddhartha Nalluri , Borzoo Bonakdarpour , Miroslav Pajic

Interpretability of AI models allows for user safety checks to build trust in such AIs. In particular, Decision Trees (DTs) provide a global look at the learned model and transparently reveal which features of the input are critical for…

Machine Learning · Computer Science 2024-01-23 Hector Kohler , Riad Akrour , Philippe Preux

Reinforcement learning (RL) is a fundamental framework for sequential decision-making, in which an agent learns an optimal policy through interactions with an unknown environment. In settings with function approximation, many existing RL…

Machine Learning · Computer Science 2026-05-05 Ruiquan Huang , Donghao Li , Yingbin Liang , Jing Yang

This paper investigates the motion planning of autonomous dynamical systems modeled by Markov decision processes (MDP) with unknown transition probabilities over continuous state and action spaces. Linear temporal logic (LTL) is used to…

Machine Learning · Computer Science 2022-01-25 Mingyu Cai , Mohammadhosein Hasanbeig , Shaoping Xiao , Alessandro Abate , Zhen Kan

Reinforcement Learning (RL) has demonstrated a huge potential in learning optimal policies without any prior knowledge of the process to be controlled. Model Predictive Control (MPC) is a popular control technique which is able to deal with…

Systems and Control · Computer Science 2019-04-10 Mario Zanon , Sébastien Gros , Alberto Bemporad