English
Related papers

Related papers: A Simulation Approach to Optimal Stopping Under Pa…

200 papers

In stochastic processes with absorbing states, the quasi-stationary distribution provides valuable insights into the long-term behaviour prior to absorption. In this work, we revisit two well-established numerical methods for its…

Statistical Mechanics · Physics 2026-04-01 Sara Oliver-Bonafoux , Javier Aguilar , Tobias Galla , Raúl Toral

In the past few decades, the development of fluorescent technologies and microscopic techniques has greatly improved scientists' ability to observe real-time single-cell activities. In this paper, we consider the filtering problem associate…

Quantitative Methods · Quantitative Biology 2022-07-27 Zhou Fang , Ankit Gupta , Mustafa Khammash

Particle filtering is a powerful tool for target tracking. When the budget for observations is restricted, it is necessary to reduce the measurements to a limited amount of samples carefully selected. A discrete stochastic nonlinear…

Systems and Control · Electrical Eng. & Systems 2020-05-19 Antoine Aspeel , Amaury Gouverneur , Raphaël M. Jungers , Benoît Macq

This article introduces, and reviews recent work using, a simple optimisation technique for analysing the nonlinear stability of a state in a dynamical system. The technique can be used to identify the most efficient way to disturb a system…

Fluid Dynamics · Physics 2014-08-18 R. R. Kerswell , C. C. T. Pringle , A. P. Willis

We consider optimal stopping problems, in which a sequence of independent random variables is drawn from a known continuous density. The objective of such problems is to find a procedure which maximizes the expected reward; this is often…

Probability · Mathematics 2020-12-07 Hugh Entwistle , Christopher Lustri , Georgy Sofronov

We consider the problem of estimating the possibly non-convex cost of an agent by observing its interactions with a nonlinear, non-stationary and stochastic environment. For this inverse problem, we give a result that allows to estimate the…

Optimization and Control · Mathematics 2023-07-24 Émiland Garrabé , Hozefa Jesawada , Carmen Del Vecchio , Giovanni Russo

We consider stochastic optimal control of linear dynamical systems with additive non-Gaussian disturbance. We propose a novel, sampling-free approach, based on Fourier transformations and convex optimization, to cast the stochastic optimal…

Optimization and Control · Mathematics 2020-10-06 Vignesh Sivaramakrishnan , Abraham P. Vinod , Meeko M. K. Oishi

Recently, there has been a surge in interest in safe and robust techniques within reinforcement learning (RL). Current notions of risk in RL fail to capture the potential for systemic failures such as abrupt stoppages from system failures…

Systems and Control · Computer Science 2019-10-09 David Mguni

We consider the Chance Constrained Model Predictive Control problem for polynomial systems subject to disturbances. In this problem, we aim at finding optimal control input for given disturbed dynamical system to minimize a given cost…

Optimization and Control · Mathematics 2016-05-04 Ashkan Jasour , Constantino Lagoa

The stochastic optimal control of many agents is an important problem in various fields. We investigate the problem of partial observations, where the state of each agent is not fully observed and the control must be decided based on noisy…

Optimization and Control · Mathematics 2023-05-30 Aaron Zeff Palmer

We design receding horizon control strategies for stochastic discrete-time linear systems with additive (possibly) unbounded disturbances, while obeying hard bounds on the control inputs. We pose the problem of selecting an appropriate…

Optimization and Control · Mathematics 2011-07-07 Debasish Chatterjee , Peter Hokayem , John Lygeros

We derive a posteriori error estimators for an optimal control problem governed by a convection-reaction-diffusion equation; control constraints are also considered. We consider a family of low-order stabilized finite element methods to…

Numerical Analysis · Mathematics 2017-04-24 Alejandro Allendes , Enrique Otarola , Richard Rankin

We solve the problem of optimal stopping of a Brownian motion subject to the constraint that the stopping time's distribution is a given measure consisting of finitely-many atoms. In particular, we show that this problem can be converted to…

Optimization and Control · Mathematics 2017-07-07 Erhan Bayraktar , Christopher W. Miller

A thermodynamically consistent particle-based model for fluid dynamics with continuous velocities and a non-ideal equation of state is presented. Excluded volume interactions are modeled by means of biased stochastic multiparticle…

Soft Condensed Matter · Physics 2009-11-11 Thomas Ihle , Erkan Tuzel , Daniel M. Kroll

In this paper, we are concerned with a stochastic optimal control problem of mean-field type under partial observation, where the state equation is governed by the controlled nonlinear mean-field stochastic differential equation, moreover…

Optimization and Control · Mathematics 2016-11-15 Maonin Tang , Qingxin Meng

This work addresses the problem of risk-sensitive control for nonlinear systems with imperfect state observations, extending results for the linear case. In particular, we derive an algorithm that can compute local solutions with…

Optimization and Control · Mathematics 2021-10-22 Bilal Hammoud , Armand Jordana , Ludovic Righetti

We address the design and synthesis of optimal control strategies for high-dimensional stochastic dynamical systems. Such systems may be deterministic nonlinear systems evolving from random initial states, or systems driven by random…

Numerical Analysis · Mathematics 2020-08-26 Panos Lambrianides , Qi Gong , Daniele Venturi

In this paper we present numerical methods - finite differences and finite elements - for solution of partial differential equation of fractional order in time for one-dimensional space. This equation describes anomalous diffusion which is…

Mathematical Physics · Physics 2007-05-23 Mariusz Ciesielski , Jacek Leszczynski

We study the optimal stopping problem of maximizing the variance of an unkilled linear diffusion. Especially, we demonstrate how the problem can be solved as a convex two-player zero-sum game, and reveal quite surprising application of game…

Probability · Mathematics 2020-03-25 Kamille Sofie Tågholt Gad , Pekka Matomäki

The purpose of this paper is two-fold: We extend the well-known relation between optimal stopping and randomized stopping of a given stochastic process to a situation where the available information flow is a filtration with no a priori…

Optimization and Control · Mathematics 2021-04-28 Nacira Agram , Sven Haadem , Bernt Oksendal , Frank Proske