English
Related papers

Related papers: Stochastic internal habit formation and optimality

200 papers

Future sequence represents the outcome after executing the action into the environment (i.e. the trajectory onwards). When driven by the information-theoretic concept of mutual information, it seeks maximally informative consequences.…

Machine Learning · Computer Science 2023-11-15 Jianfei Ma

Within the framework of viscosity solution, we study the relationship between the maximum principle (MP) in [9] and the dynamic programming principle (DPP) in [10] for a fully coupled forward-backward stochastic controlled system (FBSCS)…

Optimization and Control · Mathematics 2018-05-17 Mingshang Hu , Shaolin Ji , Xiaole Xue

We develop a prototypical stochastic model for local search around a given home. The stochastic dynamic model is motivated by experimental findings of the motion of a fruit fly around a given spot of food but shall generally describe local…

Statistical Mechanics · Physics 2018-09-12 J. Noetel , V. L. S. Freitas , E. E. N. Macau , L. Schimansky-Geier

We address the design and synthesis of optimal control strategies for high-dimensional stochastic dynamical systems. Such systems may be deterministic nonlinear systems evolving from random initial states, or systems driven by random…

Numerical Analysis · Mathematics 2020-08-26 Panos Lambrianides , Qi Gong , Daniele Venturi

In this paper, we consider the stochastic optimal control problems under G-expectation. Based on the theory of backward stochastic differential equations driven by G-Brownian motion, which was introduced in [10.11], we can investigate the…

Probability · Mathematics 2013-08-19 Zhonghao Zheng , Xiuchun Bi , Shuguang Zhang

In multi-period stochastic optimization problems, the future optimal decision is a random variable whose distribution depends on the parameters of the optimization problem. We analyze how the expected value of this random variable changes…

Optimization and Control · Mathematics 2020-01-28 Bar Light

Stochastic process discovery is concerned with deriving a model capable of reproducing the stochastic character of observed executions of a given process, stored in a log. This leads to an optimisation problem in which the model's parameter…

Formal Languages and Automata Theory · Computer Science 2025-05-01 Pierre Cry , Paolo Ballarini , András Horváth , Pascale Le Gall

We here adapt an extended version of the adaptive cubic regularisation method with dynamic inexact Hessian information for nonconvex optimisation in [3] to the stochastic optimisation setting. While exact function evaluations are still…

Numerical Analysis · Mathematics 2020-09-15 Stefania Bellavia , Gianmarco Gurioli

``When in a difficult situation, it is sometimes better to give up and start all over again''. While this empirical truth has been regularly observed in a wide range of circumstances, quantifying the effectiveness of such a heuristic…

Statistical Mechanics · Physics 2023-02-20 Benjamin De Bruyne , Francesco Mori

From economics point of view, we investigate a new optimal control problem driven by a stochastic differential equation with a multi-time states cost functional. By constructing a series of first-order adjoint equations, we establish the…

Optimization and Control · Mathematics 2016-09-15 Shuzhen Yang

Stochastic thermodynamics lays down a broad framework to revisit the venerable concepts of heat, work and entropy production for individual stochastic trajectories of mesoscopic systems. Remarkably, this approach, relying on stochastic…

Statistical Mechanics · Physics 2023-01-31 David Guéry-Odelin , Christopher Jarzynski , Carlos A. Plata , Antonio Prados , Emmanuel Trizac

Probabilistic control design is founded on the principle that a rational agent attempts to match modelled with an arbitrary desired closed-loop system trajectory density. The framework was originally proposed as a tractable alternative to…

Machine Learning · Computer Science 2023-11-16 Tom Lefebvre

This study presents the extension of the data-driven optimal prediction approach to the dynamical system with control. The optimal prediction is used to analyze dynamical systems in which the states consist of resolved and unresolved…

Dynamical Systems · Mathematics 2024-06-05 Aleksandr Katrutsa , Ivan Oseledets , Sergey Utyuzhnikov

We provide an overview of an optimal control problem within a stochastic model of tumor growth, which includes drug application. The model comprises two stochastic differential equations (SDE) representing the diffusion of nutrient and drug…

Optimization and Control · Mathematics 2024-11-12 Noelymar Farinacci

We consider a general class of dynamic resource allocation problems within a stochastic optimal control framework. This class of problems arises in a wide variety of applications, each of which intrinsically involves resources of different…

Optimization and Control · Mathematics 2018-01-08 Xuefeng Gao , Yingdong Lu , Mayank Sharma , Mark S. Squillante , Joost W. Bosman

In this article we present a general framework for non-concave robust stochastic control problems under model uncertainty in a discrete time finite horizon setting. Our framework allows to consider a variety of different path-dependent…

Optimization and Control · Mathematics 2025-05-06 Ariel Neufeld , Julian Sester

This paper explores stochastic control models in the context of decarbonization within the energy market. We study three progressively complex scenarios: (1) a single firm operating with two technologies-one polluting and one clean,(2)two…

General Finance · Quantitative Finance 2025-06-18 Benhao Du , Thomas Treillard , Francois Wang

This paper derives an optimal control strategy for a simple stochastic dynamical system with constant drift and an additive control input. Motivated by the example of a physical system with an unexpected change in its dynamics, we take the…

Optimization and Control · Mathematics 2022-02-09 Daniel Gurevich , Debdipta Goswami , Charles L. Fefferman , Clarence W. Rowley

This paper investigates the theoretical behavior of generative models under finite training populations. Within the stochastic interpolation generative framework, we derive closed-form expressions for the optimal velocity field and score…

Machine Learning · Computer Science 2025-09-29 Yunchen Li , Shaohui Lin , Zhou Yu

In this paper, a general stochastic model with controls applied at the moments when the random process hits the boundary of a given subset of the state set is proposed and studied. The general concept of the model is formulated and its…

Optimization and Control · Mathematics 2019-06-27 P. V. Shnurkov