English
Related papers

Related papers: Variational Policy for Guiding Point Processes

200 papers

We use martingale and stochastic analysis techniques to study a continuous-time optimal stopping problem, in which the decision maker uses a dynamic convex risk measure to evaluate future rewards. We also find a saddle point for an…

Probability · Mathematics 2009-11-23 Erhan Bayraktar , Ioannis Karatzas , Song Yao

Inverse optimal control can be used to characterize behavior in sequential decision-making tasks. Most existing work, however, is limited to fully observable or linear systems, or requires the action signals to be known. Here, we introduce…

Machine Learning · Computer Science 2023-10-31 Dominik Straub , Matthias Schultheis , Heinz Koeppl , Constantin A. Rothkopf

In this paper, we consider a varying terminal time structure for the stochastic optimal control problem under state constraints, in which the terminal time varies with the mean value of the state. In this new stochastic optimal control…

Optimization and Control · Mathematics 2024-09-05 Jin Shi , Shuzhen Yang

We introduce a variational algorithm to estimate the likelihood of a rare event within a nonequilibrium molecular dynamics simulation through the evaluation of an optimal control force. Optimization of a control force within a chosen basis…

Statistical Mechanics · Physics 2021-01-14 Avishek Das , David T. Limmer

This work addresses the optimal covariance control problem for stochastic discrete-time linear time-varying systems subject to chance constraints. Covariance steering is a stochastic control problem to steer the system state Gaussian…

Optimization and Control · Mathematics 2018-04-10 Kazuhide Okamoto , Maxim Goldshtein , Panagiotis Tsiotras

With the simultaneous rise of energy costs and demand for cloud computing, efficient control of data centers becomes crucial. In the data center control problem, one needs to plan at every time step how many servers to switch on or off in…

Performance · Computer Science 2018-01-25 Paul Weng , Zeqi Qiu , John Costanzo , Xiaoqi Yin , Bruno Sinopoli

The problem of synthesizing an optimal sensor selection policy is pertinent to a variety of engineering applications ranging from event detection to autonomous navigation. We consider such a synthesis problem over an infinite time horizon…

Systems and Control · Electrical Eng. & Systems 2020-12-24 Michael Hibbard , Kirsten Tuggle , Takashi Tanaka

When optimizing problems with uncertain parameter values in a linear objective, decision-focused learning enables end-to-end learning of these values. We are interested in a stochastic scheduling problem, in which processing times are…

Machine Learning · Computer Science 2024-08-16 Kim van den Houten , David M. J. Tax , Esteban Freydell , Mathijs de Weerdt

We address the design and synthesis of optimal control strategies for high-dimensional stochastic dynamical systems. Such systems may be deterministic nonlinear systems evolving from random initial states, or systems driven by random…

Numerical Analysis · Mathematics 2020-08-26 Panos Lambrianides , Qi Gong , Daniele Venturi

In this paper, we propose an efficient implementation of deep policy gradient method (PGM) for optimal control problems in continuous time. The proposed method has the ability to manage the allocation of computational resources, number of…

Optimization and Control · Mathematics 2025-02-25 Arash Fahim , Md. Arafatur Rahman

This paper concerns discrete-time infinite-horizon stochastic control systems with Borel state and action spaces and universally measurable policies. We study optimization problems on strategic measures induced by the policies in these…

Optimization and Control · Mathematics 2023-12-22 Huizhen Yu

This paper establishes a stochastic maximum principle for optimal control problems governed by time-changed forward-backward stochastic differential equations with L\'evy noise. The system incorporates a random, non-decreasing operational…

Optimization and Control · Mathematics 2026-03-27 Jingwei Chen , Jun Ye , Feng Chen

This paper proposes a stochastic model predictive control method for linear systems affected by additive Gaussian disturbances that optimizes over disturbance feedback matrices online. Closed-loop satisfaction of probabilistic constraints…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Marcell Bartos , Alexandre Didier , Jerome Sieber , Johannes Köhler , Melanie N. Zeilinger

This paper presents a method to approximately solve stochastic optimal control problems in which the cost function and the system dynamics are polynomial. For stochastic systems with polynomial dynamics, the moments of the state can be…

Optimization and Control · Mathematics 2017-02-24 Andrew Lamperski , Khem Raj Ghusinga , Abhyudai Singh

In this paper, we revisit the computation of controlled invariant sets for linear discrete-time systems through a trajectory-based viewpoint. We begin by introducing the notion of convex feasible points, which provides a new…

Optimization and Control · Mathematics 2026-05-06 Emmanuel Junior Wafo Wembe , Adnane Saoud

In this paper we develop a novel, discrete-time optimal control framework for mechanical systems with uncertain model parameters. We consider finite-horizon problems where the performance index depends on the statistical moments of the…

Optimization and Control · Mathematics 2017-05-17 George I. Boutselis , Yunpeng Pan , Gerardo De La Tore , Evangelos A. Theodorou

We design receding horizon control strategies for stochastic discrete-time linear systems with additive (possibly) unbounded disturbances, while obeying hard bounds on the control inputs. We pose the problem of selecting an appropriate…

Optimization and Control · Mathematics 2011-07-07 Debasish Chatterjee , Peter Hokayem , John Lygeros

In this paper, we establish a general stochastic maximum principle for optimal control for systems described by a continuous-time Markov regime-switching stochastic recursive utilities model. The control domain is postulated not to be…

Optimization and Control · Mathematics 2019-05-02 Liangquan Zhang , Xun Li

Efficiently computing the optimal control policy concerning a complicated future with stochastic disturbance has always been a challenge. The predicted stochastic future disturbance can be represented by a scenario tree, but solving the…

Systems and Control · Electrical Eng. & Systems 2021-08-31 Ran Jing , Xiangrui Zeng

This paper studies a continuous-time market {under stochastic environment} where an agent, having specified an investment horizon and a target terminal mean return, seeks to minimize the variance of the return with multiple stocks and a…

Portfolio Management · Quantitative Finance 2013-02-28 Wan-Kai Pang , Yuan-Hua Ni , Xun Li , Ka-Fai Cedric Yiu