English
Related papers

Related papers: Optimal Drift Rate Control and Impulse Control for…

200 papers

Stochastic optimal control problems have a long tradition in applied probability, with the questions addressed being of high relevance in a multitude of fields. Even though theoretical solutions are well understood in many scenarios, their…

Statistics Theory · Mathematics 2024-05-28 Sören Christensen , Claudia Strauch , Lukas Trottner

Consider the problem of a central bank that wants to manage the exchange rate between its domestic currency and a foreign one. The central bank can purchase and sell the foreign currency, and each intervention on the exchange market leads…

Optimization and Control · Mathematics 2017-12-07 Giorgio Ferrari , Tiziano Vargiolu

We consider a stochastic system whose uncontrolled state dynamics are modelled by a general one-dimensional It\^{o} diffusion. The control effort that can be applied to this system takes the form that is associated with the so-called…

Probability · Mathematics 2007-11-15 Andrew J. F. Jack , Timothy C. Johnson , Mihail Zervos

The goal of this paper is to solve a class of stochastic optimal control problems numerically, in which the state process is governed by an It\^o type stochastic differential equation with control process entering both in the drift and the…

Optimization and Control · Mathematics 2020-06-05 Richard Archibald , Feng Bao , Jiongmin Yong , Tao Zhou

Optimal control theory deals with finding protocols to steer a system between assigned initial and final states, such that a trajectory-dependent cost function is minimized. The application of optimal control to stochastic systems is an…

Statistical Mechanics · Physics 2024-09-18 Julia Sanders , Marco Baldovin , Paolo Muratore-Ginanneschi

Optimal control of stochastic nonlinear dynamical systems is a major challenge in the domain of robot learning. Given the intractability of the global control problem, state-of-the-art algorithms focus on approximate sequential optimization…

Machine Learning · Computer Science 2020-04-23 Joe Watson , Hany Abdulsamad , Jan Peters

This paper considers optimal control problems defined by a monotone dynamical system, a monotone cost, and monotone constraints. We identify families of such problems for which the optimal solution is bang-ride, i.e., always operates on the…

Optimization and Control · Mathematics 2023-12-15 Hamed Taghavian , Ross Drummond , Mikael Johansson

This paper is concerned with the partial information optimal control problem of wa controlled forward-backward stochastic differential equation of jump diffusion with correlated noises between the system and the observation. For this type…

Probability · Mathematics 2017-08-28 Qingxin Meng

We consider the problem of stochastic optimal control, where the state-feedback control policies take the form of a probability distribution and where a penalty on the entropy is added. By viewing the cost function as a Kullback- Leibler…

Optimization and Control · Mathematics 2024-12-12 Marc Lambert , Francis Bach , Silvère Bonnabel

The paper studies approximations and control of a processor sharing (PS) server where the service rate depends on the number of jobs occupying the server. The control of such a system is implemented by imposing a limit on the number of jobs…

Systems and Control · Computer Science 2014-09-02 Varun Gupta , Jiheng Zhang

This paper describes the structure of optimal policies for discounted periodic-review single-commodity total-cost inventory control problems with fixed ordering costs for finite and infinite horizons. There are known conditions in the…

Optimization and Control · Mathematics 2017-05-30 Eugene A. Feinberg , Yan Liang

Optimal control theory is an effective tool to improve parameter estimation of quantum systems. Different methods can be employed for the design of the control protocol. They can be based either on Quantum Fischer Information (QFI)…

Quantum Physics · Physics 2023-06-21 Quentin Ansel , Etienne Dionis , Dominique Sugny

In this paper, we consider a class of continuous-time, continuous-space stochastic optimal control problems. Building upon recent advances in Markov chain approximation methods and sampling-based algorithms for deterministic path planning,…

Robotics · Computer Science 2012-02-27 Vu Anh Huynh , Sertac Karaman , Emilio Frazzoli

In this paper, we investigate the optimization of mutual proportional reinsurance --- a mutual reserve system that is intended for the collective reinsurance needs of homogeneous mutual members, such as P&I Clubs in marine mutual insurance…

Optimization and Control · Mathematics 2011-12-20 John Liu , Michael Taksar , Jiguang Yuan

This paper considers the problem of partially observed optimal control for forward stochastic systems which are driven by Brownian motions and an independent Poisson random measure with a feature that the cost functional is of mean-field…

Probability · Mathematics 2014-03-19 Yaozhong Hu , David Nualart , Qing Zhou

We consider a periodic review inventory control problem having an underlying modulation process that affects demand and that is partially observed by the uncensored demand process and a novel additional observation data (AOD) process. We…

Optimization and Control · Mathematics 2022-02-15 Satya S. Malladi , Alan L. Erera , Chelsea C. White

In this paper, we consider a general time-inconsistent optimal control problem for a non homogeneous linear system, in which its state evolves according to a stochastic differential equation with deterministic coefficients, when the noise…

Optimization and Control · Mathematics 2015-05-19 Ishak Alia , Farid Chighoub , Ayesha Sohail

We present a novel particle filtering framework for continuous-time dynamical systems with continuous-time measurements. Our approach is based on the duality between estimation and optimal control, which allows reformulating the estimation…

Optimization and Control · Mathematics 2021-10-08 Qinsheng Zhang , Amirhossein Taghvaei , Yongxin Chen

This paper studies convergence properties of optimal values and actions for discounted and average-cost Markov Decision Processes (MDPs) with weakly continuous transition probabilities and applies these properties to the stochastic…

Optimization and Control · Mathematics 2017-03-21 Eugene A. Feinberg , Mark E. Lewis

In this paper, we consider a class of stochastic impulse control problem when there is a fixed delay $\Delta$ between the decision and execution times. The dynamics of the controlled system between two impulses is an arbitrary adapted…

Probability · Mathematics 2026-01-23 Said Hamadène , Ibtissam Hdhiri