English
Related papers

Related papers: Discrete-time probabilistic approximation of path-…

200 papers

Probabilistic programs with mixed support (both continuous and discrete latent random variables) commonly appear in many probabilistic programming systems (PPSs). However, the existence of the discrete random variables prohibits many basic…

Machine Learning · Computer Science 2020-03-06 David Tolpin , Yuan Zhou , Hongseok Yang

In this paper, a new approach based on convex analysis is introduced to solve the $H_\infty$ problem for discrete-time nonlinear stochastic systems. A stochastic version of bounded real lemma is proved and the state feedback $H_\infty$…

Optimization and Control · Mathematics 2017-10-27 Xiangyun Lin , Tianliang Zhang , Weihai Zhang , Bor-Sen Chen

Two-time-scale stochastic approximation, a generalized version of the popular stochastic approximation, has found broad applications in many areas including stochastic control, optimization, and machine learning. Despite its popularity,…

Optimization and Control · Mathematics 2021-03-24 Thinh T. Doan

We obtain non asymptotic concentration bounds for two kinds of stochastic approximations. We first consider the deviations between the expectation of a given function of the Euler scheme of some diffusion process at a fixed deterministic…

Probability · Mathematics 2012-12-12 Noufel Frikha , Stephane Menozzi

We present a novel multilevel Monte Carlo approach for estimating quantities of interest for stochastic partial differential equations (SPDEs). Drawing inspiration from [Giles and Szpruch: Antithetic multilevel Monte Carlo estimation for…

Numerical Analysis · Mathematics 2025-04-15 Abdul-Lateef Haji-Ali , Andreas Stein

In this paper, we study functional type weak approximation of weak solutions of stochastic functional differential equations by means of the Euler--Maruyama scheme. Under mild assumptions on the coefficients, we provide a quantitative error…

Probability · Mathematics 2024-12-25 Yushi Hamaguchi , Dai Taguchi

We consider a class of stochastic optimal control problems for discrete-time stochastic linear systems which seek for control policies that will steer the probability distribution of the terminal state of the system close to a desired…

Optimization and Control · Mathematics 2020-10-01 Isin M. Balci , Efstathios Bakolas

Stochastic gradient Markov Chain Monte Carlo algorithms are popular samplers for approximate inference, but they are generally biased. We show that many recent versions of these methods (e.g. Chen et al. (2014)) cannot be corrected using…

Machine Learning · Statistics 2021-02-03 Adrià Garriga-Alonso , Vincent Fortuin

In this paper we investigate the convergence of the Policy Iteration Algorithm (PIA) for a class of general continuous-time entropy-regularized stochastic control problems. In particular, instead of employing sophisticated PDE estimates for…

Optimization and Control · Mathematics 2025-04-24 Jin Ma , Gaozhan Wang , Jianfeng Zhang

We apply the sample average approximation (SAA) method to risk-neutral optimization problems governed by nonlinear partial differential equations (PDEs) with random inputs. We analyze the consistency of the SAA optimal values and SAA…

Optimization and Control · Mathematics 2023-08-03 Johannes Milz

A simple-to-implement weak-sense numerical method to approximate reflected stochastic differential equations (RSDEs) is proposed and analysed. It is proved that the method has the first order of weak convergence. Together with the Monte…

Numerical Analysis · Mathematics 2024-02-06 B. Leimkuhler , A. Sharma , M. V. Tretyakov

We investigate a numerical behaviour of robust deterministic optimal control problem subject to a convection diffusion equation containing uncertain inputs. Stochastic Galerkin approach, turning the original optimization problem containing…

Numerical Analysis · Mathematics 2023-03-01 Pelin Çiloğlu , Hamdullah Yücel

We consider the discretization in time of a system of parabolic stochastic partial differential equations with slow and fast components; the fast equation is driven by an additive space-time white noise. The numerical method is inspired by…

Numerical Analysis · Mathematics 2012-02-14 Charles-Edouard Bréhier

The development of efficient numerical methods for kinetic equations with stochastic parameters is a challenge due to the high dimensionality of the problem. Recently we introduced a multiscale control variate strategy which is capable to…

Numerical Analysis · Mathematics 2018-12-14 Giacomo Dimarco , Lorenzo Pareschi

We develop diffusion-based samplers for target distributions known up to a normalising constant. To this end, we rely on the well-known diffusion path that smoothly interpolates between a simple base distribution and the target, popularised…

A comprehensive convergence and stability analysis of some probabilistic numerical methods designed to solve Cauchy-type inverse problems is performed in this study. Such inverse problems aim at solving an elliptic partial differential…

Numerical Analysis · Mathematics 2025-08-12 Iulian Cîmpean , Andreea Grecu , Liviu Marin

The theory of Wasserstein gradient flows in the space of probability measures has made an enormous progress over the last twenty years. It constitutes a unified and powerful framework in the study of dissipative partial differential…

Analysis of PDEs · Mathematics 2022-01-17 Daniel Adams , Manh Hong Duong , Goncalo dos Reis

Many systems such as autonomous vehicles and quadrotors are subject to parametric uncertainties and external disturbances. These uncertainties can lead to undesired performance degradation and safety issues. Therefore, it is important to…

Systems and Control · Electrical Eng. & Systems 2019-10-09 Huishan Chen , Zheng Zhang

A deterministic-stochastic coupling scheme is developed for simulating rarefied gas flows, where the key process is the alternative solving of the macroscopic synthetic equations [Su et al., J. Comput. Phys., 407 (2020) 109245] and the…

Computational Physics · Physics 2024-06-26 Liyan Luo , Qi Li , Fei Fei , Lei Wu

This paper focuses on the invariance control problem for discrete-time switched nonlinear systems. The proposed approach computes controlled invariant sets in a finite number of iterations and directly yields a partition-based invariance…

Optimization and Control · Mathematics 2016-09-01 Yinan Li , Jun Liu