English
Related papers

Related papers: Rolling Horizon Policies in Multistage Stochastic …

200 papers

Meal delivery services provided by platforms with integrated delivery systems are becoming increasingly popular. This paper adopts a rolling horizon approach to solve the meal delivery routing problem (MDRP). To improve delivery efficiency…

Systems and Control · Electrical Eng. & Systems 2023-05-10 Lejun Zhou , Anke Ye , Simon Hu

Decision making needs to take an uncertain environment into account. Over the last decades, robust optimization has emerged as a preeminent method to produce solutions that are immunized against uncertainty. The main focus in robust…

Optimization and Control · Mathematics 2021-02-11 Marc Goerigk , Michael Hartisch

Stochastic rounding (SR) is a probabilistic rounding mode that mitigates errors in large-scale numerical computations, especially when prone to stagnation effects. Beyond numerical analysis, SR has shown significant benefits in practical…

Numerical Analysis · Mathematics 2026-03-26 El-Mehdi El Arar , Massimiliano Fasi , Silviu-Ioan Filip , Mantas Mikaitis

Bounded policy iteration is an approach to solving infinite-horizon POMDPs that represents policies as stochastic finite-state controllers and iteratively improves a controller by adjusting the parameters of each node using linear…

Artificial Intelligence · Computer Science 2012-06-18 Eric A. Hansen

Probabilistic sampling methods have become very popular to solve single-shot path planning problems. Rapidly-exploring Random Trees (RRTs) in particular have been shown to be efficient in solving high dimensional problems. Even though…

Artificial Intelligence · Computer Science 2009-12-02 Nicolas A. Barriga , Mauricio Araya-López

In modern engineering scenarios, there is often a strict upper bound on the number of algorithm iterations that can be performed within a given time limit. This raises the question of optimal algorithmic configuration for a fixed and finite…

Optimization and Control · Mathematics 2024-12-31 Yushun Zhang , Dmitry Rybin , Zhi-Quan Luo

Constrained Markov Decision Processes (CMDPs) formalize sequential decision-making problems whose objective is to minimize a cost function while satisfying constraints on various cost functions. In this paper, we consider the setting of…

Machine Learning · Computer Science 2020-09-25 Krishna C. Kalagarla , Rahul Jain , Pierluigi Nuzzo

Many control problems in environments that can be modeled as Markov decision processes (MDPs) concern infinite-time horizon specifications. The classical aim in this context is to compute a control policy that maximizes the probability of…

Systems and Control · Computer Science 2017-05-03 Ruediger Ehlers , Salar Moarref , Ufuk Topcu

We study a class of infinite horizon impulse control problems with execution delay when the dynamics of the system is described by a general adapted stochastic process. The problem is solved by means of probabilistic tools relying on the…

Probability · Mathematics 2019-05-21 Boualem Djehiche , Said Hamadene , Ibtissem Hdhiri , Helmi Zaatra

We study multistage distributionally robust linear optimization, where the uncertainty set is defined as a ball of distribution centered at a scenario tree using the nested distance. The resulting minimax problem is notoriously difficult to…

Optimization and Control · Mathematics 2024-07-24 Rui Gao , Rohit Arora , Yizhe Huang

This paper studies a structured compound stochastic program (SP) involving multiple expectations coupled by nonconvex and nonsmooth functions. We present a successive convex-programming based sampling algorithm and establish its…

Optimization and Control · Mathematics 2021-05-25 Junyi Liu , Ying Cui , Jong-Shi Pang

We study risk-aware linear policy approximations for the optimal operation of an energy system with stochastic wind power, storage, and limited fuel. The resulting problem is a sequential decision-making problem with rolling forecasts. In…

Systems and Control · Electrical Eng. & Systems 2024-07-19 Thomas Mortimer , Robert Mieth

Long-term reservoir management often uses bounds on the reservoir level, between which the operator can work. However, these bounds are not always kept up-to-date with the latest knowledge about the reservoir drainage area, and thus become…

Optimization and Control · Mathematics 2018-01-29 Thibaut Cuvelier , Pierre Archambeau , Benjamin Dewals , Quentin Louveaux

To guarantee the well-functioning of electricity distribution networks, it is crucial to constantly ensure the demand-supply balance. To do this, one can control the means of production, but also influence the demand: demand-side management…

Optimization and Control · Mathematics 2021-03-01 Luce Brotcorne , Sébastien Lepaul , Léonard von Niederhäusern

Multiobjective stochastic programming is a field well located to tackle problems arising in emergencies, given that uncertainty and multiple objectives are usually present in such problems. A new concept of solution is proposed in this…

Optimization and Control · Mathematics 2021-02-08 Javier León , Justo Puerto , Begoña Vitoriano

We address the stochastic transmission expansion planning (STEP) problem under uncertainty in renewable generation capacity and demand. STEP's objective is to minimize total transmission investment and generation costs. To tackle the…

Optimization and Control · Mathematics 2026-05-12 Yure Rocha , Teobaldo Bulhões , Anand Subramanian , Joaquim Dias Garcia

The Receding Horizon Control (RHC) strategy consists in replacing an infinite-horizon stabilization problem by a sequence of finite-horizon optimal control problems, which are numerically more tractable. The dynamic programming principle…

Optimization and Control · Mathematics 2019-06-06 Karl Kunisch , Laurent Pfeiffer

To model combinatorial decision problems involving uncertainty and probability, we introduce scenario based stochastic constraint programming. Stochastic constraint programs contain both decision variables, which we can set, and stochastic…

Artificial Intelligence · Computer Science 2009-03-09 S. Armagan Tarim , Suresh Manandhar , Toby Walsh

This paper introduces a node formulation for multistage stochastic programs with endogenous (i.e., decision-dependent) uncertainty. Problems with such structure arise when the choices of the decision maker determine a change in the…

Optimization and Control · Mathematics 2021-03-05 Giovanni Pantuso

We use one-step conditional risk mappings to formulate a risk averse version of a total cost problem on a controlled Markov process in discrete time infinite horizon. The nonnegative one step costs are assumed to be lower semi-continuous…

Optimization and Control · Mathematics 2018-06-05 Kerem Ugurlu