English
Related papers

Related papers: Approximating class approach for empirical process…

200 papers

We consider statistical learning question for $\psi$-weakly dependent processes, that unifies a large class of weak dependence conditions such as mixing, association,$\cdots$ The consistency of the empirical risk minimization algorithm is…

Statistics Theory · Mathematics 2022-10-04 Mamadou Lamine Diop , William Kengne

We formulate a uniform tail bound for empirical processes indexed by a class of functions, in terms of the individual deviations of the functions rather than the worst-case deviation in the considered class. The tail bound is established by…

Probability · Mathematics 2026-03-27 Sohail Bahmani

In this paper, we give precise rates of convergence in the strong invariance principle for stationary sequences of bounded real-valued random variables satisfying weak dependence conditions. One of the main ingredients is a new Fuk-Nagaev…

Probability · Mathematics 2023-07-06 J Dedecker , F Merlevède , Emmanuel Rio

We investigate the use of a certain class of functional inequalities known as weak Poincar\'e inequalities to bound convergence of Markov chains to equilibrium. We show that this enables the straightforward and transparent derivation of…

Computation · Statistics 2024-09-25 Christophe Andrieu , Anthony Lee , Sam Power , Andi Q. Wang

In this paper, we obtain some uniform laws of large numbers and functional central limit theorems for sequential empirical measure processes indexed by classes of product functions satisfying appropriate Vapnik-Chervonenkis properties.

Probability · Mathematics 2008-11-03 Omar El-Dakkak

We study a variable length Markov chain model associated with a group of stationary processes that share the same context tree but each process has potentially different conditional probabilities. We propose a new model selection and…

Methodology · Statistics 2016-01-01 Alexandre Belloni , Roberto I. Oliveira

In order to give quantitative estimates for approximating the ergodic limit, we investigate probabilistic limit behaviors of time-averaging estimators of numerical discretizations for a class of time-homogeneous Markov processes, by…

Probability · Mathematics 2023-10-13 Chuchu Chen , Tonghe Dang , Jialin Hong , Guoting Song

We establish a multivariate empirical process central limit theorem for stationary $\R^d$-valued stochastic processes $(X_i)_{i\geq 1}$ under very weak conditions concerning the dependence structure of the process. As an application we can…

Probability · Mathematics 2011-01-28 Herold Dehling , Olivier Durieu

In this paper we provide a rigorous mathematical foundation for continuous approximations of a class of systems with piece-wise continuous functions. By using techniques from the theory of differential inclusions, the underlying piece-wise…

Chaotic Dynamics · Physics 2014-08-20 Marius-F. Danca

In some papers on infinite Markov chains in $\mathbb{Z}^d$, and notably in the work of R.A. Minlos and collaborators, one can prove the existence of a spectral gap for a suitable subspace of local functions. We consider functions of the…

Mathematical Physics · Physics 2015-08-03 Carlo Boldrighini , Antonella Marchesiello , Chiara Saffirio

We consider a Markov chain obtained by random iterations of Lipschitz maps $T_i$ chosen with a probability $p_i(x)$ depending on the current position $x$. We assume this system has a property of "contraction on average", that is $\sum_i…

Probability · Mathematics 2012-06-22 Olivier Durieu

For a certain class of McKean-Vlasov processes, we introduce proxy processes that substitute the mean-field interaction with self-interaction, employing a weighted occupation measure. Our study encompasses two key achievements. First, we…

Probability · Mathematics 2025-11-04 Kai Du , Zhenjie Ren , Florin Suciu , Songbo Wang

Systems of interacting continuous-time Markov chains are a powerful model class, but inference is typically intractable in high dimensional settings. Auxiliary information, such as noisy observations, is typically only available at discrete…

Machine Learning · Statistics 2026-04-21 Giosue Migliorini , Padhraic Smyth

We provide an empirical process theory for locally stationary processes over nonsmooth function classes. An important novelty over other approaches is the use of the flexible functional dependence measure to quantify dependence. A…

Statistics Theory · Mathematics 2021-08-20 Nathawut Phandoidaen , Stefan Richter

We study the statistical inference of nonlinear stochastic approximation algorithms utilizing a single trajectory of Markovian data. Our methodology has practical applications in various scenarios, such as Stochastic Gradient Descent (SGD)…

Statistics Theory · Mathematics 2023-02-21 Xiang Li , Jiadong Liang , Zhihua Zhang

Slow mixing is the central hurdle when working with Markov chains, especially those used for Monte Carlo approximations (MCMC). In many applications, it is only of interest to estimate the stationary expectations of a small set of…

Statistics Theory · Mathematics 2016-10-04 Maxim Rabinovich , Aaditya Ramdas , Michael I. Jordan , Martin J. Wainwright

We analyze the dynamics of an algorithm for approximate inference with large Gaussian latent variable models in a student-teacher scenario. To model nontrivial dependencies between the latent variables, we assume random covariance matrices…

Machine Learning · Computer Science 2020-08-26 Burak Çakmak , Manfred Opper

We introduce a new class of stochastic processes which are stationary, Markovian and characterized by an infinite range of time-scales. By transforming the Fokker-Planck equation of the process into a Schrodinger equation with an…

Statistical Mechanics · Physics 2007-05-23 Fabrizio Lillo , Salvatore Micciche' , Rosario N. Mantegna

We study episodic reinforcement learning in Markov decision processes when the agent receives additional feedback per step in the form of several transition observations. Such additional observations are available in a range of tasks…

Machine Learning · Computer Science 2020-05-11 Christoph Dann , Yishay Mansour , Mehryar Mohri , Ayush Sekhari , Karthik Sridharan

We show that for a typical coordinate projection of a subgaussian class of functions, the infimum over signs $\inf_{(\epsilon_i)}{\sup_{f\in F}}|{\sum_{i=1}^k\epsilon_i}f(X_i)|$ is asymptotically smaller than the expectation over signs as a…

Probability · Mathematics 2011-04-11 Shahar Mendelson