English
Related papers

Related papers: Time discretization and Markovian iteration for co…

200 papers

In this paper we introduce an iterative Jacobi algorithm for solving distributed model predictive control (DMPC) problems, with linear coupled dynamics and convex coupled constraints. The algorithm guarantees stability and persistent…

Optimization and Control · Mathematics 2008-09-23 Dang Doan , Tamas Keviczky , Ion Necoara , Moritz Diehl

Multilevel strategies are an integral part of many image registration algorithms. These strategies are very well-known for avoiding undesirable local minima, providing an outstanding initial guess, and reducing overall computation time.…

Signal Processing · Electrical Eng. & Systems 2020-01-22 Hari Om Aggrawal , Jan Modersitzki

We consider a fully discretized numerical scheme for parabolic stochastic partial differential equations with multiplicative noise. Our abstract framework can be applied to formulate a non-iterative domain decomposition approach. Such…

Numerical Analysis · Mathematics 2024-12-16 Monika Eisenmann , Eskil Hansen , Marvin Jans

A number of problems in a variety of fields are characterised by target distributions with a multimodal structure in which the presence of several isolated local maxima dramatically reduces the efficiency of Markov Chain Monte Carlo…

Methodology · Statistics 2009-07-31 Miquel Trias , Alberto Vecchio , John Veitch

We propose a deep learning algorithm for solving high-dimensional parabolic integro-differential equations (PIDEs) and high-dimensional forward-backward stochastic differential equations with jumps (FBSDEJs), where the jump-diffusion…

Numerical Analysis · Mathematics 2023-01-31 Wansheng Wang , Jie Wang , Jinping Li , Feifei Gao , Yi Fu

Although many real-world stochastic planning problems are more naturally formulated by hybrid models with both discrete and continuous variables, current state-of-the-art methods cannot adequately address these problems. We present the…

Artificial Intelligence · Computer Science 2012-07-19 Carlos E. Guestrin , Milos Hauskrecht , Branislav Kveton

Continuous-time Markov chains associated to finite-volume discretization schemes of Fokker-Planck equations are constructed. Sufficient conditions under which quantitative exponential decay in the $\phi$-entropy and Wasserstein distance are…

Probability · Mathematics 2025-11-12 Ansgar Jüngel , Katharina Schuh

We study the convergence of stochastic fixed point iterations in the consistent case (in the sense of Butnariu and Fl{\aa}m (1995)) in several different settings, under decreasingly restrictive regularity assumptions of the fixed point…

Optimization and Control · Mathematics 2020-03-26 Neal Hermer , D. Russell Luke , Anja Sturm

A comprehensive mathematical model of the multiphysics flow of blood and Cerebrospinal Fluid (CSF) in the brain can be expressed as the coupling of a poromechanics system and Stokes' equations: the first describes fluids filtration through…

Numerical Analysis · Mathematics 2023-11-03 Ivan Fumagalli , Mattia Corti , Nicola Parolini , Paola F. Antonietti

In the present work, we delve into further study of numerical approximations of SDEs with non-globally monotone coefficients. We design and analyze a new family of stopped increment-tamed time discretization schemes of Euler, Milstein and…

Numerical Analysis · Mathematics 2024-10-08 Lei Dai , Xiaojie Wang

A novel discretization is presented for forward-backward stochastic differential equations (FBSDE) with differentiable coefficients, simultaneously solving the BSDE and its Malliavin sensitivity problem. The control process is estimated by…

Numerical Analysis · Mathematics 2021-10-12 Balint Negyesi , Kristoffer Andersson , Cornelis W. Oosterlee

This paper proposes a numerical method based on the Adomian decomposition approach for the time discretization, applied to Euler equations. A recursive property is demonstrated that allows to formulate the method in an appropriate and…

Numerical Analysis · Mathematics 2022-04-19 Imanol Garcia-Beristain , Lakhdar Remaki

We study a general class of singular degenerate parabolic stochastic partial differential equations (SPDEs) which include, in particular, the stochastic porous medium equations and the stochastic fast diffusion equation. We propose a fully…

Numerical Analysis · Mathematics 2020-12-23 Ľubomír Baňas , Benjamin Gess , Christian Vieth

We show that the semi-implicit time discretization approaches previously introduced for multilayer shallow water models for the barotropic case can be also applied to the variable density case with Boussinesq approximation. Furthermore,…

Numerical Analysis · Mathematics 2021-04-27 Luca Bonaventura , José Garres-Díaz

We consider multiple parallel Markov decision processes (MDPs) coupled by global constraints, where the time varying objective and constraint functions can only be observed after the decision is made. Special attention is given to how well…

Optimization and Control · Mathematics 2017-09-12 Xiaohan Wei , Hao Yu , Michael J. Neely

Mixed dimensional partial differential equations (PDEs) are equations coupling unknown fields defined over domains of differing topological dimension. Such equations naturally arise in a wide range of scientific fields including geology,…

Mathematical Software · Computer Science 2019-11-05 Cécile Daversin-Catty , Chris N. Richardson , Ada J. Ellingsrud , Marie E. Rognes

Recent non-asymptotic analyses have substantially advanced the theory of distributional policy evaluation, but they largely concern synchronous full-state updates under a generative model, model-based estimators, accelerated variants, or…

Machine Learning · Computer Science 2026-05-11 Ege C. Kaya , Abolfazl Hashemi

Continuous-time Bayesian networks (CTBNs) are graphical representations of multi-component continuous-time Markov processes as directed graphs. The edges in the network represent direct influences among components. The joint rate matrix of…

Artificial Intelligence · Computer Science 2012-07-02 Nir Friedman , Raz Kupferman

We present a numerical method to compute the survival function and the moments of the exit time for a piecewise-deterministic Markov process (PDMP). Our approach is based on the quantization of an underlying discrete-time Markov chain…

Probability · Mathematics 2011-08-31 Adrien Brandejsky , Benoîte de Saporta , François Dufour

In [5] the authors suggested a new algorithm for the numerical approximation of a BSDE by merging the cubature method with the first order discretization developed by [3] and [16]. Though the algorithm presented in [5] compared…

Probability · Mathematics 2010-12-30 Dan Crisan , Konstantinos Manolarakis