English
Related papers

Related papers: A probability approximation framework: Markov proc…

200 papers

This paper deals with the problem of quantifying the approximation a probability measure by means of an empirical (in a wide sense) random probability measure, depending on the first n terms of a sequence of random elements. In Section 2,…

Probability · Mathematics 2018-08-23 Emanuele Dolera , Eugenio Regazzini

Biochemical reactions can happen on different time scales and also the abundance of species in these reactions can be very different from each other. Classical approaches, such as deterministic or stochastic approach, fail to account for or…

Quantitative Methods · Quantitative Biology 2014-09-16 Arnab Ganguly , Derya Altintan , Heinz Koeppl

Hybrid systems whose mode dynamics are governed by non-linear ordinary differential equations (ODEs) are often a natural model for biological processes. However such models are difficult to analyze. To address this, we develop a…

Systems and Control · Computer Science 2015-06-23 Benjamin M. Gyori , Bing Liu , Soumya Paul , R. Ramanathan , P. S. Thiagarajan

We introduce a distance between kernels based on the Wasserstein distances between their values, study its properties, and prove that it is a metric on an appropriately defined space of kernels. We also relate it to various modes of…

Optimization and Control · Mathematics 2024-01-29 Zhengqi Lin , Andrzej Ruszczynski

Gradient-based algorithms are one of the methods of choice for the optimisation of Markov Decision Processes. In this article we will present a novel approximate Newton algorithm for the optimisation of such models. The algorithm has…

Optimization and Control · Mathematics 2015-08-05 Thomas Furmston , David Barber

We propose a novel approach to numerically approximate McKean-Vlasov stochastic differential equations (MV-SDE) using stochastic gradient descent (SGD) while avoiding the use of interacting particle systems (IPS) {and the associated…

Numerical Analysis · Mathematics 2026-01-22 Ankush Agarwal , Andrea Amato , Goncalo dos Reis , Stefano Pagliarani

We give a new take on the error analysis of approximations of stochastic differential equations (SDEs), utilizing and developing the stochastic sewing lemma of L\^e (2020). This approach allows one to exploit regularization by noise effects…

Probability · Mathematics 2021-08-10 Oleg Butkovsky , Konstantinos Dareiotis , Máté Gerencsér

The law of the iterated logarithm (LIL) for the time-homogeneous Markov process with a unique invariant measure characterizes the almost sure maximum possible fluctuation of time averages around the ergodic limit. Whether a numerical…

Numerical Analysis · Mathematics 2025-11-10 Chuchu Chen , Xinyu Chen , Jialin Hong

Parameter estimation in Markov random fields (MRFs) is a difficult task, in which inference over the network is run in the inner loop of a gradient descent procedure. Replacing exact inference with approximate methods such as loopy belief…

Machine Learning · Computer Science 2012-06-18 Varun Ganapathi , David Vickrey , John Duchi , Daphne Koller

This article presents a general approximation-theoretic framework to analyze measure transport algorithms for probabilistic modeling. A primary motivating application for such algorithms is sampling -- a central task in statistical…

Numerical Analysis · Mathematics 2024-09-19 Ricardo Baptista , Bamdad Hosseini , Nikola B. Kovachki , Youssef M. Marzouk , Amir Sagiv

This paper investigates Gaussian Markov random field approximations to nonstationary Gaussian fields using graph representations of stochastic partial differential equations. We establish approximation error guarantees building on the…

Methodology · Statistics 2021-04-28 Daniel Sanz-Alonso , Ruiyi Yang

Computing the marginal likelihood or evidence is one of the core challenges in Bayesian analysis. While there are many established methods for estimating this quantity, they predominantly rely on using a large number of posterior samples…

Computation · Statistics 2021-02-26 Eric Chuu , Debdeep Pati , Anirban Bhattacharya

We derive a finite-sample probabilistic bound on the parameter estimation error of a system identification algorithm for Linear Switched Systems. The algorithm estimates Markov parameters from a single trajectory and applies a variant of…

Machine Learning · Computer Science 2025-05-19 Daniel Racz , Mihaly Petreczky , Balint Daroczy

In the following article we provide an exposition of exact computational methods to perform parameter inference from partially observed network models. In particular, we consider the duplication attachment (DA) model which has a likelihood…

Computation · Statistics 2013-06-20 Junshan Wang , Ajay Jasra , Maria De Iorio

Understanding stochastic gradient descent (SGD) and its variants is essential for machine learning. However, most of the preceding analyses are conducted under amenable conditions such as unbiased gradient estimator and bounded objective…

Machine Learning · Statistics 2024-03-26 Tianyou Li , Fan Chen , Huajie Chen , Zaiwen Wen

Methods for solving PDEs using neural networks have recently become a very important topic. We provide an a priori error analysis for such methods which is based on the $\mathcal{K}_1(\mathbb{D})$-norm of the solution. We show that the…

Numerical Analysis · Mathematics 2022-07-15 Qingguo Hong , Jonathan W. Siegel , Jinchao Xu

Stochastic processes are often represented through orthonormal series expansions, a framework originating in the classical works of Lo\`eve and Karhunen and widely used for simulation and numerical approximation. While truncation error in…

Statistics Theory · Mathematics 2026-03-30 Oleksandr Mokliachuk

Recently-proposed particle MCMC methods provide a flexible way of performing Bayesian inference for parameters governing stochastic kinetic models defined as Markov (jump) processes (MJPs). Each iteration of the scheme requires an estimate…

Computation · Statistics 2014-05-19 Andrew Golightly , Daniel A. Henderson , Chris Sherlock

The challenging problem of conducting fully Bayesian inference for the reaction rate constants governing stochastic kinetic models (SKMs) is considered. Given the challenges underlying this problem, the Markov jump process representation is…

Computation · Statistics 2019-01-10 Andrew Golightly , Emma Bradley , Tom Lowe , Colin S. Gillespie

We propose an original particle-based implementation of the Loopy Belief Propagation (LPB) algorithm for pairwise Markov Random Fields (MRF) on a continuous state space. The algorithm constructs adaptively efficient proposal distributions…

Computation · Statistics 2015-06-22 Thibaut Lienart , Yee Whye Teh , Arnaud Doucet
‹ Prev 1 8 9 10 Next ›