English
Related papers

Related papers: Computing optimal policies for managing inventorie…

200 papers

Gaussian processes (GPs) offer a flexible, uncertainty-aware framework for modeling complex signals, but scale cubically with data, assume static targets, and are brittle to outliers, limiting their applicability in large-scale problems…

Machine Learning · Statistics 2025-09-23 Fernando Llorente , Daniel Waxman , Sanket Jantre , Nathan M. Urban , Susan E. Minkoff

Since its inception in the mid-60s, the inventory staggering problem has been explored and exploited in a wide range of application domains, such as production planning, stock control systems, warehousing, and aerospace/defense logistics.…

Data Structures and Algorithms · Computer Science 2025-06-13 Noga Alon , Danny Segev

In modern robotics, effectively computing optimal control policies under dynamically varying environments poses substantial challenges to the off-the-shelf parametric policy gradient methods, such as the Deep Deterministic Policy Gradient…

Robotics · Computer Science 2022-03-29 Apan Dastider , Mingjie Lin

Many retailers today employ inventory management systems based on Re-Order Point Policies, most of which rely on the assumption that all decreases in product inventory levels result from product sales. Unfortunately, it usually happens that…

Machine Learning · Statistics 2016-04-06 Luis I. Reyes-Castro , Andres G. Abad

Deep Reinforcement Learning (DRL) techniques have received significant attention in control and decision-making algorithms. Most applications involve complex decision-making systems, justified by the algorithms' computational power and…

Systems and Control · Electrical Eng. & Systems 2024-02-28 Fatemeh Tavakkoli , Pouria Sarhadi , Benoit Clement , Wasif Naeem

Reinforcement Learning (RL) applied to financial problems has been the subject of a lively area of research. The use of RL for optimal trading strategies that exploit latent information in the market is, to the best of our knowledge, not…

Trading and Market Microstructure · Quantitative Finance 2025-11-04 Andrea Macrì , Sebastian Jaimungal , Fabrizio Lillo

A large class of decision making under uncertainty problems can be described via Markov decision processes (MDPs) or partially observable MDPs (POMDPs), with application to artificial intelligence and operations research, among others.…

Artificial Intelligence · Computer Science 2021-09-10 Mohamadreza Ahmadi , Ugo Rosolia , Michel D. Ingham , Richard M. Murray , Aaron D. Ames

The paper proposes a new stochastic intervention control model conducted in various commodity and stock markets. The essence of the phenomenon of intervention is described in accordance with current economic theory. A review of papers on…

General Finance · Quantitative Finance 2018-11-28 Peter Shnurkov , Daniil Novikov

Deep Gaussian Processes (DGPs) were proposed as an expressive Bayesian model capable of a mathematically grounded estimation of uncertainty. The expressivity of DPGs results from not only the compositional character but the distribution…

Machine Learning · Computer Science 2021-11-23 Chi-Ken Lu , Patrick Shafto

We propose a robust and efficient data-driven predictive control (eDDPC) scheme which is more sample efficient (requires less offline data) compared to existing schemes, and is also computationally efficient. This is done by leveraging an…

Systems and Control · Electrical Eng. & Systems 2024-09-30 Mohammad Alsalti , Manuel Barkey , Victor G. Lopez , Matthias A. Müller

Model-free reinforcement learning algorithms such as Deep Deterministic Policy Gradient (DDPG) often require additional exploration strategies, especially if the actor is of deterministic nature. This work evaluates the use of model-based…

Machine Learning · Computer Science 2019-11-19 Kevin Sebastian Luck , Mel Vecerik , Simon Stepputtis , Heni Ben Amor , Jonathan Scholz

Decentralized optimization is typically studied under the assumption of noise-free transmission. However, real-world scenarios often involve the presence of noise due to factors such as additive white Gaussian noise channels or…

Optimization and Control · Mathematics 2023-07-28 Suhail M. Shah , Raghu Bollapragada

We argue that inventory management presents unique opportunities for the reliable application of deep reinforcement learning (DRL). To enable this, we emphasize and test two complementary techniques. The first is Hindsight Differentiable…

Machine Learning · Computer Science 2025-09-12 Matias Alvo , Daniel Russo , Yash Kanoria , Minuk Lee

Novel advanced policy gradient (APG) methods, such as Trust Region policy optimization and Proximal policy optimization (PPO), have become the dominant reinforcement learning algorithms because of their ease of implementation and good…

Optimization and Control · Mathematics 2022-03-22 J. G. Dai , Mark Gluzman

Policy search reinforcement learning has been drawing much attention as a method of learning a robot control policy. In particular, policy search using such non-parametric policies as Gaussian process regression can learn optimal actions…

Robotics · Computer Science 2021-06-15 Hikaru Sasaki , Takamitsu Matsubara

We consider the task of evaluating a policy for a Markov decision process (MDP). The standard unbiased technique for evaluating a policy is to deploy the policy and observe its performance. We show that the data collected from deploying a…

Artificial Intelligence · Computer Science 2017-06-13 Josiah P. Hanna , Philip S. Thomas , Peter Stone , Scott Niekum

Civil and maritime engineering systems, among others, from bridges to offshore platforms and wind turbines, must be efficiently managed as they are exposed to deterioration mechanisms throughout their operational life, such as fatigue or…

Artificial Intelligence · Computer Science 2021-11-30 P. G. Morato , K. G. Papakonstantinou , C. P. Andriotis , J. S. Nielsen , P. Rigo

Most existing decentralized learning methods with differential privacy (DP) guarantee rely on constant gradient clipping bounds and fixed-level DP Gaussian noises for each node throughout the training process, leading to a significant…

Machine Learning · Computer Science 2025-05-13 Zehan Zhu , Yan Huang , Xin Wang , Shouling Ji , Jinming Xu

Stochastic Gradient Descent (SGD) is the workhorse algorithm of deep learning technology. At each step of the training phase, a mini batch of samples is drawn from the training dataset and the weights of the neural network are adjusted…

Disordered Systems and Neural Networks · Physics 2022-09-07 Francesca Mignacco , Pierfrancesco Urbani

A policy in deep reinforcement learning (RL), either deterministic or stochastic, is commonly parameterized as a Gaussian distribution alone, limiting the learned behavior to be unimodal. However, the nature of many practical…

Machine Learning · Computer Science 2025-08-20 SM Mazharul Islam , Manfred Huber