English
Related papers

Related papers: Performance of a Markovian neural network versus d…

200 papers

This paper deals with the question of how to most effectively conduct experiments in Partially Observed Markov Decision Processes so as to provide data that is most informative about a parameter of interest. Methods from Markov decision…

Other Statistics · Statistics 2018-01-31 Leifur Thorbergsson , Giles Hooker

In planning problems, it is often challenging to fully model the desired specifications. In particular, in human-robot interaction, such difficulty may arise due to human's preferences that are either private or complex to model.…

Robotics · Computer Science 2021-01-01 Mahsa Ghasemi , Evan Scope Crafts , Bo Zhao , Ufuk Topcu

We consider a stochastic individual based model where each predator searches during a random time and then manipulates its prey or rests. The time distributions may be non-exponential. An age structure allows to describe these interactions…

Dynamical Systems · Mathematics 2021-03-31 Vincent Bansaye , Bertand Cloez

In this paper, we present a scalable deep learning approach to solve opinion dynamics stochastic optimal control problems with mean field term coupling in the dynamics and cost function. Our approach relies on the probabilistic…

Multiagent Systems · Computer Science 2022-04-19 Tianrong Chen , Ziyi Wang , Evangelos A. Theodorou

We study a stochastic control problem on a bounded domain, which arises from a continuous-time optimal management model. Via the corresponding Hamilton-Jacobi-Bellman equation the value function is shown to be jointly continuous and to…

Probability · Mathematics 2017-10-24 Ruoting Gong , Christian Houdré

The numerical realization of the dynamic programming principle for continuous-time optimal control leads to nonlinear Hamilton-Jacobi-Bellman equations which require the minimization of a nonlinear mapping over the set of admissible…

Optimization and Control · Mathematics 2015-02-26 Dante Kalise , Axel Kröner , Karl Kunisch

In this paper, we propose control-theoretic methods as tools for the design of online optimization algorithms that are able to address dynamic, noisy, and partially uncertain time-varying quadratic objective functions. Our approach…

Optimization and Control · Mathematics 2025-02-03 Umberto Casti , Sandro Zampieri

This paper considers a non-Markov control problem arising in a financial market where asset returns depend on hidden factors. The problem is non-Markov because nonlinear filtering is required to make inference on these factors, and hence…

Mathematical Finance · Quantitative Finance 2018-07-24 Andrew Papanicolaou

The aim of this work is to develop a deep learning method for solving high-dimensional stochastic control problems based on the Hamilton--Jacobi--Bellman (HJB) equation and physics-informed learning. Our approach is to parameterize the…

Optimization and Control · Mathematics 2025-06-23 Zhe Jiao , Wantao Jia , Weiqiu Zhu

We provide an overview on how to use the measurable selection techniques to derive the dynamic programming principle for a general stochastic optimal control/stopping problem. By considering its martingale problem formulation on the…

Optimization and Control · Mathematics 2024-10-03 Nicole El Karoui , Xiaolu Tan

This article presents an innovative approach to integrating port-Hamiltonian systems with neural network architectures, transitioning from deterministic to stochastic models. The study presents novel mathematical formulations and…

Dynamical Systems · Mathematics 2024-03-26 Luca Di Persio , Matthias Ehrhardt , Sofia Rizzotto

In recent years, nonlinear dynamic system identification using artificial neural networks has garnered attention due to its broad potential applications across science and engineering. However, purely data-driven approaches often struggle…

Machine Learning · Computer Science 2025-11-06 Fabian J. Roth , Dominik K. Klein , Maximilian Kannapinn , Jan Peters , Oliver Weeger

When a physical system is driven away from equilibrium, the statistical distribution of its dynamical trajectories informs many of its physical properties. Characterizing the nature of the distribution of dynamical observables, such as a…

Statistical Mechanics · Physics 2024-06-19 Jiawei Yan , Grant M. Rotskoff

We consider the problem of maximizing expected utility for a power investor who can allocate his wealth in a stock, a defaultable security, and a money market account. The dynamics of these security prices are governed by geometric Brownian…

Portfolio Management · Quantitative Finance 2014-06-04 Agostino Capponi , Jose Enrique Figueroa Lopez , Andrea Pascucci

This paper investigates optimal portfolio strategies in a market where the drift is driven by an unobserved Markov chain. Information on the state of this chain is obtained from stock prices and expert opinions in the form of signals at…

Portfolio Management · Quantitative Finance 2016-02-03 Rüdiger Frey , Abdelali Gabih , Ralf Wunderlich

In this paper, we study backward doubly stochastic recursive optimal control problem where the cost function is described by the solution of a backward doubly stochastic differential equation. We give the dynamical programming principle for…

Probability · Mathematics 2020-08-13 Yunhong Li , Anis. Matoussi , Lifeng Wei , Zhen Wu

A new method for stochastic control based on neural networks and using randomisation of discrete random variables is proposed and applied to optimal stopping time problems. The method models directly the policy and does not need the…

Computational Finance · Quantitative Finance 2021-01-11 Thomas Deschatre , Joseph Mikael

This note reviews our mathematical models for fish schooling, considered in free space, and in space with obstacle and food resource. These models are performed by stochastic differential equations or stochastic partial differential…

Statistical Mechanics · Physics 2025-08-13 Linh Thi Hoai Nguyen , Ton Viet Ta , Atsushi Yagi

We present a stochastic optimal control problem for a tree network. The dynamics of the network are governed by transport equations with a special emphasis on the non-linear damping function. Demand profiles at the network sinks are…

Optimization and Control · Mathematics 2022-02-11 Simone Göttlich , Thomas Schillinger

In marine management, fish stocks are often managed on a stock-by-stock basis using single-species models. Many of these models are based upon statistical techniques and are good at assessing the current state and making short-term…