English
Related papers

Related papers: Exponential Convergence Rates for Stochastically O…

200 papers

The time evolution of complex systems usually can be described through stochastic processes. These processes are measured at finite resolution, what necessarily reduces them to finite sequences of real numbers. In order to relate these data…

Condensed Matter · Physics 2007-05-23 D. M. Tavares , L. S. Lucena

We study the ergodic behaviour of a discrete-time process $X$ which is a Markov chain in a stationary random environment. The laws of $X_t$ are shown to converge to a limiting law in (weighted) total variation distance as $t\to\infty$.…

Probability · Mathematics 2019-07-29 Balazs Gerencser , Miklos Rasonyi

This paper tackles the issue of establishing a lower-bound on the asymptotic ratio of survival probabilities between two different initial conditions, asymptotically in time for a given Markov process with extinction. Such a comparison is a…

Probability · Mathematics 2023-05-12 Aurélien Velleret

We provide a rather explicit formula for the resolvent of a~concatenation of $N$ processes in terms of their exit laws and certain probability measures characterizing the way the processes are concatenated. As an application, we prove an…

Probability · Mathematics 2022-04-21 Adam Bobrowski

A Markovian single-server queue is studied in an interactive random environment. The arrival and service rates of the queue depend on the environment, while the transition dynamics of the random environment depends on the queue length. We…

Probability · Mathematics 2020-01-10 Yana Belopolskaya , Guodong Pang , Andrey Sarantsev , Yurii Suhov

The use of higher-order stochastic processes such as nonlinear Markov chains or vertex-reinforced random walks is significantly growing in recent years as they are much better at modeling high dimensional data and nonlinear dynamics in…

Numerical Analysis · Mathematics 2020-04-29 Dario Fasino , Francesco Tudisco

Scientific explanation often requires inferring maximally predictive features from a given data set. Unfortunately, the collection of minimal maximally predictive features for most stochastic processes is uncountably infinite. In such…

Statistical Mechanics · Physics 2017-05-31 Sarah E. Marzen , James P. Crutchfield

We obtain the lower bounds for ergodic convergence rates, including spectral gaps and convergence rates in strong ergodicity for time-changed symmetric L\'{e}vy processes by using harmonic function and reversible measure. As direct…

Probability · Mathematics 2021-09-08 Tao Wang

A powerful tool for studying long-term convergence of a Markov process to its stationary distribution is a Lyapunov function. In some sense, this is a substitute for eigenfunctions. For a stochastically ordered Markov process on the…

Probability · Mathematics 2021-03-01 Andrey Sarantsev

We study a variable length Markov chain model associated with a group of stationary processes that share the same context tree but each process has potentially different conditional probabilities. We propose a new model selection and…

Methodology · Statistics 2016-01-01 Alexandre Belloni , Roberto I. Oliveira

We consider the problem of bounding mean first passage times for a class of continuous-time Markov chains that captures stochastic interactions between groups of identical agents. The quantitative analysis of such probabilistic population…

Systems and Control · Electrical Eng. & Systems 2020-04-07 Michael Backenköhler , Luca Bortolussi , Verena Wolf

This paper studies the exponential stability of random matrix products driven by a general (possibly unbounded) state space Markov chain. It is a cornerstone in the analysis of stochastic algorithms in machine learning (e.g. for parameter…

Machine Learning · Statistics 2021-02-02 Alain Durmus , Eric Moulines , Alexey Naumov , Sergey Samsonov , Hoi-To Wai

In this paper, we quantitative convergence in $W_2$ for a family of Langevin-like stochastic processes that includes stochastic gradient descent and related gradient-based algorithms. Under certain regularity assumptions, we show that the…

Statistics Theory · Mathematics 2019-07-03 Xiang Cheng , Peter L. Bartlett , Michael I. Jordan

In this work, multiplicative stochasticity is applied to the learning rate of stochastic optimization algorithms, giving rise to stochastic learning-rate schemes. In-expectation theoretical convergence results of Stochastic Gradient Descent…

Optimization and Control · Mathematics 2022-03-22 Theodoros Mamalis , Dusan Stipanovic , Petros Voulgaris

We provide an original and general sufficient criterion ensuring the exponential contraction of Feynman-Kac semi-groups of penalized processes. This criterion is applied to time-inhomogeneous one-dimensional diffusion processes conditioned…

Probability · Mathematics 2016-03-25 Nicolas Champagnat , Denis Villemonais

Error bound conditions (EBC) are properties that characterize the growth of an objective function when a point is moved away from the optimal set. They have recently received increasing attention in the field of optimization for developing…

Machine Learning · Statistics 2018-05-15 Mingrui Liu , Xiaoxuan Zhang , Lijun Zhang , Rong Jin , Tianbao Yang

In this paper we propose a new method for approximating the nonstationary moment dynamics of one dimensional Markovian birth-death processes. By expanding the transition probabilities of the Markov process in terms of Poisson-Charlier…

Numerical Analysis · Mathematics 2014-09-23 Stefan Engblom , Jamol Pender

We study the entropy rate of pattern sequences of stochastic processes, and its relationship to the entropy rate of the original process. We give a complete characterization of this relationship for i.i.d. processes over arbitrary…

Information Theory · Computer Science 2007-07-13 George M. Gemelos , Tsachy Weissman

Designing and analyzing optimization methods via continuous-time models expressed as ordinary differential equations (ODEs) is a promising approach for its intuitiveness and simplicity. A key concern, however, is that the convergence rates…

Optimization and Control · Mathematics 2025-12-30 Kansei Ushiyama , Shun Sato , Takayasu Matsuo

Consider an M/M/$s$ queue with the additional feature that the arrival rate is a random variable of which only the mean, variance, and range are known. Using semi-infinite linear programming and duality theory for moment problems, we…