English
Related papers

Related papers: Memory and Anticipation: Two main theorems for Mar…

200 papers

This paper presents three versions of maximum principle for a stochastic optimal control problem of Markov regime-switching forward-backward stochastic differential equations with jumps (FBSDEJs). A general sufficient maximum principle for…

Optimization and Control · Mathematics 2014-10-14 Olivier Menoukeu Pamen

We address a class of Markov jump linear systems that are characterized by the underlying Markov process being time-inhomogeneous with a priori unknown transition probabilities. Necessary and sufficient conditions for uniform stochastic…

Systems and Control · Computer Science 2014-11-24 Collin C. Lutz , Daniel J. Stilwell

Markov jump processes are continuous-time stochastic processes with a wide range of applications in both natural and social sciences. Despite their widespread use, inference in these models is highly non-trivial and typically proceeds via…

Machine Learning · Computer Science 2023-06-01 Patrick Seifner , Ramses J. Sanchez

This paper introduces a backward stochastic differential equation driven by both Brownian motion and a Markov chain (BSDEBM). Regime-switching is also incorporated through its driver. The existence and uniqueness of the solution of the…

Probability · Mathematics 2022-03-08 Engel John C. Dela Vega , Robert J. Elliott

This paper focuses on time-varying delayed stochastic differential systems with stochastically switching parameters formulated by a unified switching behavior combining a discrete adapted process and a Cox process. Unlike prior studies…

Dynamical Systems · Mathematics 2024-01-30 Xinyu Wu , Zidong Wang , Wenlian Lu

Many time series are effectively generated by a combination of deterministic continuous flows along with discrete jumps sparked by stochastic events. However, we usually do not have the equation of motion describing the flows, or how they…

Machine Learning · Computer Science 2020-01-09 Junteng Jia , Austin R. Benson

Stochastic thermodynamics investigates energetic and entropic bounds in small systems. Foundational results, e.g., the first and second laws, predominantly rely on the Markov (memoryless) assumption. Although physicists recognise that the…

Statistical Mechanics · Physics 2026-05-12 Kiyoshi Kanazawa , Andreas Dechant

Markov chains are the de facto finite-state model for stochastic dynamical systems, and Markov decision processes (MDPs) extend Markov chains by incorporating non-deterministic behaviors. Given an MDP and rewards on states, a classical…

Logic in Computer Science · Computer Science 2024-11-13 Krishnendu Chatterjee , Laurent Doyen

In this paper, we, for the first time, establish two comparison theorems for multi-dimensional backward stochastic differential equations with jumps. Our approach is novel and completely different from the existing results for…

Probability · Mathematics 2023-11-14 Ying Hu , Xiaomin Shi , Zuo Quan Xu

In this paper we study backward stochastic differential equations (BSDEs) driven by the compensated random measure associated to a given pure jump Markov process X on a general state space K. We apply these results to prove well-posedness…

Probability · Mathematics 2013-02-05 Fulvia Confortola , Marco Fuhrman

The main contributions of this paper are three fold. First, our primary concern is to investigate a class of stochastic recursive delayed control problems which arise naturally with sound backgrounds but have not been well-studied yet. For…

Optimization and Control · Mathematics 2011-12-06 Li Chen , Jianhui Huang

This paper aims to develop the stability theory for singular stochastic Markov jump systems with state-dependent noise, including both continuous- and discrete-time cases. The sufficient conditions for the existence and uniqueness of a…

Optimization and Control · Mathematics 2015-09-04 Yong Zhao , Weihai Zhang

In the paper, we are concerned with degenerate stochastic differential equations with jumps. Firstly, we establish two support theorems for the solutions of the degenerate stochastic equations, under different (sufficient) conditions.…

Probability · Mathematics 2020-02-06 Huijie Qiao , Jiang-Lun Wu

In this paper, we consider a class of multi-dimensional stochastic delay differential equations with jump reflection. Based on existence and uniqueness of the strong solution to the equation, we prove that the Markov semigroup generated by…

Probability · Mathematics 2016-01-29 Lijun Bo , Chenggui Yuan

In this paper we prove the existence and uniqueness theorem, comparison theorem of a class of anticipated mean-field backward stochastic differential equations with jumps.

Optimization and Control · Mathematics 2019-05-22 Tao Hao

In this paper, we proved moderate deviation principles for a fully coupled two-time-scale stochastic systems, where the slow process is given by stochastic differential equations with small noise, while the fast process is a rapidly…

Probability · Mathematics 2025-12-02 Hongjiang Qian

In this paper, we study the stochastic optimal control problem for control system with time-varying delay. The corresponding stochastic differential equation is a kind of stochastic differential delay equation. We prove the existence and…

Optimization and Control · Mathematics 2024-01-17 Yuhang Li , Yuecai Han

This paper develops a new class of conditional Markov jump processes with regime switching and paths dependence. The key novel feature of the developed process lies on its ability to switch the transition rate as it moves from one state to…

Methodology · Statistics 2021-07-16 Budhi Surya

In this paper we establish a comparison theorem for stochastic differential delay equations with jumps. An example is constructed to demonstrate that the comparison theorem need not hold whenever the diffusion term contains a delay function…

Probability · Mathematics 2011-02-11 Jianhai Bao , Chenggui Yuan

We prove a stochastic maximum principle for a control problem where the state equation is delayed both in the state and in the control, and also the final cost functional may depend on the past trajectories. The adjoint equations turn out…

Probability · Mathematics 2024-03-14 Giuseppina Guatteri , Federica Masiero
‹ Prev 1 2 3 10 Next ›