English
Related papers

Related papers: Almost Sure Diffusion Approximation in Averaging: …

200 papers

We present a distributed asynchronous algorithm for approximating a single component of the solution to a system of linear equations $Ax = b$, where $A$ is a positive definite real matrix, and $b \in \mathbb{R}^n$. This is equivalent to…

Data Structures and Algorithms · Computer Science 2019-01-23 Asuman Ozdaglar , Devavrat Shah , Christina Lee Yu

We prove a vector-valued almost sure invariance principle for some classes of time dependent non-uniformly distance expanding dynamical systems. The models we have in mind are certain sequential versions of the smooth non-uniformly distance…

Dynamical Systems · Mathematics 2020-05-14 Yeor Hafouta

We introduce a nonparametric approach for estimating drift and diffusion functions in systems of stochastic differential equations from observations of the state vector. Gaussian processes are used as flexible models for these functions and…

Data Analysis, Statistics and Probability · Physics 2018-08-15 Philipp Batz , Andreas Ruttor , Manfred Opper

Stochastic approximation is a foundation for many algorithms found in machine learning and optimization. It is in general slow to converge: the mean square error vanishes as $O(n^{-1})$. A deterministic counterpart known as quasi-stochastic…

Optimization and Control · Mathematics 2024-03-26 Caio Kalil Lauand , Sean Meyn

Various bias-correction methods such as EXTRA, gradient tracking methods, and exact diffusion have been proposed recently to solve distributed {\em deterministic} optimization problems. These methods employ constant step-sizes and converge…

Machine Learning · Computer Science 2023-07-19 Kun Yuan , Sulaiman A. Alghunaim , Bicheng Ying , Ali H. Sayed

In this paper we consider large state space continuous time Markov chains (MCs) arising in the field of systems biology. For density dependent families of MCs that represent the interaction of large groups of identical objects, Kurtz has…

Performance · Computer Science 2015-03-04 Alessio Angius , Gianfranco Balbo , Marco Beccuti , Enrico Bibbona , Andras Horvath , Roberta Sirovich

In this paper we consider approximations to the popular Pitman-Yor process obtained by truncating the stick-breaking representation. The truncation is determined by a random stopping rule that achieves an almost sure control on the…

Statistics Theory · Mathematics 2019-07-16 Julyan Arbel , Pierpaolo De Blasi , Igor Pruenster

We study the problem of parameters estimation in Indirect Observability contexts, where $X_t \in R^r$ is an unobservable stationary process parametrized by a vector of unknown parameters and all observable data are generated by an…

Probability · Mathematics 2016-01-20 Robert Azencott , Peng Ren , Ilya Timofeyev

In this work, we consider the problem of distributed approximation of functions over multiple-access channels with additive noise. In contrast to previous works, we take fast fading into account and give explicit probability bounds for the…

Information Theory · Computer Science 2021-03-01 Igor Bjelakovic , Matthias Frey , Slawomir Stanczak

The averaging principle for slow-fast systems of various kind of stochastic (partial) differential equations has been extensively studied. An analogous result was shown for slow-fast systems of rough differential equations driven by random…

Probability · Mathematics 2025-04-07 Yuzuru Inahama

We consider a hidden Markov model, where the signal process, given by a diffusion, is only indirectly observed through some noisy measurements. The article develops a variational method for approximating the hidden states of the signal…

Optimization and Control · Mathematics 2016-10-26 Tobias Sutter , Arnab Ganguly , Heinz Koeppl

We design a new, fast algorithm for agnostically learning univariate probability distributions whose densities are well approximated by piecewise polynomial functions. Let $f$ be the density function of an arbitrary univariate distribution,…

Data Structures and Algorithms · Computer Science 2015-06-03 Jayadev Acharya , Ilias Diakonikolas , Jerry Li , Ludwig Schmidt

This note details the development of a discrete-time diffusion process to approximate the midnight customer count process in a $M_\textrm{per}/\textrm{Geo}_\textrm{2timeScale}/N$ system. We prove a limit theorem that supports this diffusion…

Probability · Mathematics 2015-08-24 J. G. Dai , Pengyi Shi

Consider a diffusion process X, solution of a time-homogeneous stochastic differential equation. We assume that the diffusion process X is observed at discrete times, at high frequency, which means that the time step tends toward zero. In…

Statistics Theory · Mathematics 2025-06-23 Eddy Michel Ella Mintsa

This paper considers binomial approximation of continuous time stochastic processes. It is shown that, under some mild integrability conditions, a process can be approximated in mean square sense and in other strong metrics by binomial…

Computational Finance · Quantitative Finance 2015-02-09 Nikolai Dokuchaev

We describe a distributed randomized algorithm computing approximate distances and routes that approximate shortest paths. Let n denote the number of nodes in the graph, and let HD denote the hop diameter of the graph, i.e., the diameter of…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-11-05 Christoph Lenzen , Boaz Patt-Shamir

A single queueing system with time-dependent exponentially distributed arrival processes and exponential machine processes (Kendall notation $M_t/M_t/1$) is analyzed. Modeling the time evolution for the discrete queue-length distribution by…

Probability · Mathematics 2018-12-21 Dieter Armbruster , Simone Göttlich , Stephan Knapp

Density dependent families of Markov chains, such as the stochastic models of mass-action chemical kinetics, converge for large values of the indexing parameter $N$ to deterministic systems of differential equations (Kurtz, 1970). Moreover…

Probability · Mathematics 2017-07-11 Enrico Bibbona , Roberta Sirovich

In this short paper, we consider discrete-time Markov chains on lattices as approximations to continuous-time diffusion processes. The approximations can be interpreted as finite difference schemes for the generator of the process. We…

Probability · Mathematics 2016-11-08 Christoph Reisinger

The ODE method has been a workhorse for algorithm design and analysis since the introduction of the stochastic approximation. It is now understood that convergence theory amounts to establishing robustness of Euler approximations for ODEs,…

Optimization and Control · Mathematics 2020-10-02 Shuhang Chen , Adithya Devraj , Andrey Bernstein , Sean Meyn