English
Related papers

Related papers: A Reinforcement Learning Approach to the Stochasti…

200 papers

We explore reinforcement learning methods for finding the optimal policy in the linear quadratic regulator (LQR) problem. In particular, we consider the convergence of policy gradient methods in the setting of known and unknown parameters.…

Machine Learning · Computer Science 2021-06-25 Ben Hambly , Renyuan Xu , Huining Yang

We present an iterative inverse reinforcement learning algorithm to infer optimal cost functions in continuous spaces. Based on a popular maximum entropy criteria, our approach iteratively finds a weight improvement step and proposes a…

Machine Learning · Computer Science 2025-05-14 Sarmad Mehrdad , Avadesh Meduri , Ludovic Righetti

Constraint handling plays a key role in solving realistic complex optimization problems. Though intensively discussed in the last few decades, existing constraint handling techniques predominantly rely on human experts' designs, which more…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Qianhao Zhu , Sijie Ma , Zeyuan Ma , Hongshu Guo , Yue-Jiao Gong

Solving partially observable Markov decision processes (POMDPs) is highly intractable in general, at least in part because the optimal policy may be infinitely large. In this paper, we explore the problem of finding the optimal policy from…

Artificial Intelligence · Computer Science 2013-01-30 Nicolas Meuleau , Kee-Eung Kim , Leslie Pack Kaelbling , Anthony R. Cassandra

In this paper, we consider Markov Decision Processes (MDPs) with error states. Error states are those states entering which is undesirable or dangerous. We define the risk with respect to a policy as the probability of entering such a state…

Machine Learning · Computer Science 2011-09-13 P. Geibel , F. Wysotzki

We consider a periodic-review, fixed-lifetime perishable inventory control problem where demand is a general stochastic process. The optimal solution for this problem is intractable due to "curse of dimensionality". In this paper, we first…

Optimization and Control · Mathematics 2016-05-10 Can Zhang , Turgay Ayer , Chelsea C. White

We consider the problem of controlling a Markov decision process (MDP) with a large state space, so as to minimize average cost. Since it is intractable to compete with the optimal policy for large scale problems, we pursue the more modest…

Optimization and Control · Mathematics 2014-02-28 Yasin Abbasi-Yadkori , Peter L. Bartlett , Alan Malek

In this research we study a finite horizon optimal purchasing problem for items with a mean reverting price process. Under this model a fixed amount of identical items are bought under a given deadline, with the objective of minimizing the…

Optimization and Control · Mathematics 2017-11-10 Alon Dourban , Liron Yedidsion

We study reinforcement learning in infinite-horizon average-reward settings with linear MDPs. Previous work addresses this problem by approximating the average-reward setting by discounted setting and employing a value iteration-based…

Machine Learning · Computer Science 2025-04-17 Kihyuk Hong , Ambuj Tewari

Recent works using deep learning to solve the Traveling Salesman Problem (TSP) have focused on learning construction heuristics. Such approaches find TSP solutions of good quality but require additional procedures such as beam search and…

Machine Learning · Computer Science 2020-09-15 Paulo R. de O. da Costa , Jason Rhuggenaath , Yingqian Zhang , Alp Akcay

This work provides a Deep Reinforcement Learning approach to solving a periodic review inventory control system with stochastic vendor lead times, lost sales, correlated demand, and price matching. While this dynamic program has…

Machine Learning · Computer Science 2022-11-30 Dhruv Madeka , Kari Torkkola , Carson Eisenach , Anna Luo , Dean P. Foster , Sham M. Kakade

Supervised approaches for text summarisation suffer from the problem of mismatch between the target labels/scores of individual sentences and the evaluation score of the final summary. Reinforcement learning can solve this problem by…

Computation and Language · Computer Science 2017-11-15 Diego Molla

In [E. G. Birgin, O. C. Rom\~ao, and D. P. Ronconi, The multi-period two-dimensional non-guillotine cutting stock problem with usable leftovers, International Transactions in Operational Research 27(3), 1392-1418, 2020] the multi-period…

Optimization and Control · Mathematics 2023-04-28 E. G. Birgin , O. C Romão , D. P. Ronconi

When sales of a product are affected by randomness in demand, retailers can use dynamic pricing strategies to maximise their profits. In this article the pricing problem is formulated as a stochastic optimal control problem, where the…

Optimization and Control · Mathematics 2017-10-17 Asbjørn N. Riseth , Jeff N. Dewynne , Chris L. Farmer

Market makers continuously set bid and ask quotes for the stocks they have under consideration. Hence they face a complex optimization problem in which their return, based on the bid-ask spread they quote and the frequency at which they…

Trading and Market Microstructure · Quantitative Finance 2015-03-19 Olivier Guéant , Charles-Albert Lehalle , Joaquin Fernandez Tapia

We study the problem of learning optimal policies in finite-horizon Markov Decision Processes (MDPs) using low-rank reinforcement learning (RL) methods. In finite-horizon MDPs, the policies, and therefore the value functions (VFs) are not…

Machine Learning · Computer Science 2026-05-14 Sergio Rozada , Jose Luis Orejuela , Antonio G. Marques

We study contextual stochastic optimization problems, where we leverage rich auxiliary observations (e.g., product characteristics) to improve decision making with uncertain variables (e.g., demand). We show how to train forest decision…

Optimization and Control · Mathematics 2022-03-17 Nathan Kallus , Xiaojie Mao

This paper proposes a policy-based deep reinforcement learning hyper-heuristic framework for solving the Job Shop Scheduling Problem. The hyper-heuristic agent learns to switch scheduling rules based on the system state dynamically. We…

Artificial Intelligence · Computer Science 2026-01-19 Sofiene Lassoued , Asrat Gobachew , Stefan Lier , Andreas Schwung

In this paper, we study the offline sequential feature-based pricing and inventory control problem where the current demand depends on the past demand levels and any demand exceeding the available inventory is lost. Our goal is to leverage…

Machine Learning · Statistics 2026-03-12 Korel Gundem , Zhengling Qi

Inverse reinforcement learning (IRL) is the problem of finding a reward function that generates a given optimal policy for a given Markov Decision Process. This paper looks at an algorithmic-independent geometric analysis of the IRL problem…

Machine Learning · Computer Science 2021-02-19 Abi Komanduru , Jean Honorio