English
Related papers

Related papers: Strongly consistent nonparametric forecasting and …

200 papers

We study correlation estimates of automatic sequences (that is, sequences computable by finite automata) with polynomial phases. As a consequence, we provide a new class of good weights for classical and polynomial ergodic theorems, not…

Dynamical Systems · Mathematics 2018-03-21 Tanja Eisner , Jakub Konieczny

This work investigates the structural properties, cycloid trajectories, and non-asymptotic convergence guarantees of the Expectation-Maximization (EM) algorithm for two-component Mixed Linear Regression (2MLR) with unknown mixing weights…

Machine Learning · Computer Science 2025-11-10 Zhankun Luo , Abolfazl Hashemi

We study an intermittent quasistatic dynamical system composed of nonuniformly hyperbolic Pomeau--Manneville maps with time-dependent parameters. We prove an ergodic theorem which shows almost sure convergence of time averages in a certain…

Dynamical Systems · Mathematics 2016-06-22 Juho Leppänen , Mikko Stenlund

To address the difficult problem of multi-step ahead prediction of non-parametric autoregressions, we consider a forward bootstrap approach. Employing a local constant estimator, we can analyze a general type of non-parametric time series…

Methodology · Statistics 2023-11-02 Dimitris N. Politis , Kejin Wu

A common tool in the practice of Markov Chain Monte Carlo is to use approximating transition kernels to speed up computation when the desired kernel is slow to evaluate or intractable. A limited set of quantitative tools exist to assess the…

Probability · Mathematics 2026-01-14 Jeffrey Negrea , Jeffrey S. Rosenthal

The non-stationary evolution of observable quantities in complex systems can frequently be described as a juxtaposition of quasi-stationary spells. Given that standard theoretical and data analysis approaches usually rely on the assumption…

Statistical Mechanics · Physics 2011-10-18 S. Camargo , S. Duarte Queirós , C. Anteneodo

Drawing on ergodic theory, we introduce a novel training method for machine learning based forecasting methods for chaotic dynamical systems. The training enforces dynamical invariants--such as the Lyapunov exponent spectrum and fractal…

Machine Learning · Computer Science 2023-04-26 Jason A. Platt , Stephen G. Penny , Timothy A. Smith , Tse-Chun Chen , Henry D. I. Abarbanel

We show that ergodic flows in noncommutative fully symmetric spaces (associated with a semifinite von Neumann algebra) generated by continuous semigroups of positive Dunford-Schwartz operators and modulated by bounded Besicovitch almost…

Operator Algebras · Mathematics 2018-09-07 Vladimir Chilin , Semyon Litvinov

In this paper I provide simple and easily verifiable conditions under which a strong form of stochastic equicontinuity holds in a wide variety of modern time series models. In contrast to most results currently available in the literature,…

Statistics Theory · Mathematics 2014-02-20 Andreas Hagemann

This paper presents a model selection technique of estimation in semiparametric regression models of the type Y_i=\beta^{\prime}\underbarX_i+f(T_i)+W_i, i=1,...,n. The parametric and nonparametric components are estimated simultaneously by…

Statistics Theory · Mathematics 2007-06-13 Florentina Bunea

Davis and Mikosch [7] introduced the extremogram as a flexible quantitative tool for measuring various types of extremal dependence in a stationary time series. There we showed some standard statistical properties of the sample extremogram.…

Methodology · Statistics 2011-07-29 Richard A. Davis , Thomas Mikosch , Ivor Cribben

Exponential inequalities are main tools in machine learning theory. To prove exponential inequalities for non i.i.d random variables allows to extend many learning techniques to these variables. Indeed, much work has been done both on…

Machine Learning · Statistics 2020-08-03 Pierre Alquier , Paul Doukhan , Xiequan Fan

Stationarity is a very common assumption in time series analysis. A vector autoregressive process is stationary if and only if the roots of its characteristic equation lie outside the unit circle, constraining the autoregressive coefficient…

Methodology · Statistics 2022-05-18 Sarah E. Heaps

We develop a versatile framework for statistical learning in non-stationary environments. In each time period, our approach applies a stability principle to select a look-back window that maximizes the utilization of historical data while…

Machine Learning · Computer Science 2025-05-19 Chengpiao Huang , Kaizheng Wang

Estimating linear, mean-square continuous functionals is a pivotal challenge in statistics. In high-dimensional contexts, this estimation is often performed under the assumption of exact model sparsity, meaning that only a small number of…

Statistics Theory · Mathematics 2025-08-04 Jelena Bradic , Victor Chernozhukov , Whitney K. Newey , Yinchu Zhu

In this study, we develop an asymptotic theory of nonparametric regression for locally stationary random fields (LSRFs) $\{{\bf X}_{{\bf s}, A_{n}}: {\bf s} \in R_{n} \}$ in $\mathbb{R}^{p}$ observed at irregularly spaced locations in…

Statistics Theory · Mathematics 2022-07-07 Daisuke Kurisu

We study time-uniform statistical inference for parameters in stochastic approximation (SA), which encompasses a bunch of applications in optimization and machine learning. To that end, we analyze the almost-sure convergence rates of the…

Machine Learning · Statistics 2024-10-22 Chuhan Xie , Kaicheng Jin , Jiadong Liang , Zhihua Zhang

We study the ergodic behaviour of a discrete-time process $X$ which is a Markov chain in a stationary random environment. The laws of $X_t$ are shown to converge to a limiting law in (weighted) total variation distance as $t\to\infty$.…

Probability · Mathematics 2019-07-29 Balazs Gerencser , Miklos Rasonyi

Stochastic epidemic models provide an interpretable probabilistic description of the spread of a disease through a population. Yet, fitting these models to partially observed data is a notoriously difficult task due to intractability of the…

Computation · Statistics 2022-10-21 Raphael Morsomme , Jason Xu

The problem of optimal estimation of linear functionals constructed from unobserved values of stochastic sequence with periodically stationary increments based on observations of the sequence with a periodically stationary noise is…

Statistics Theory · Mathematics 2025-11-10 Maksym Luz , Mykhailo Moklyachuk