English
Related papers

Related papers: Forward estimation for ergodic time series

200 papers

This paper investigates the iterates $\hbb^1,\dots,\hbb^T$ obtained from iterative algorithms in high-dimensional linear regression problems, in the regime where the feature dimension $p$ is comparable with the sample size $n$, i.e., $p…

Machine Learning · Statistics 2024-04-30 Pierre C. Bellec , Kai Tan

Many applications, including rank aggregation and crowd-labeling, can be modeled in terms of a bivariate isotonic matrix with unknown permutations acting on its rows and columns. We consider the problem of estimating such a matrix based on…

Machine Learning · Statistics 2018-06-06 Cheng Mao , Ashwin Pananjady , Martin J. Wainwright

The estimation of parameter standard errors for semi-variogram models is challenging, given the two-step process required to fit a parametric model to spatially correlated data. Motivated by an application in the social-epidemiology, we…

Methodology · Statistics 2023-07-18 Julia Dyck , Odile Sauzet

There is a lack of simple and scalable algorithms for uncertainty quantification. Bayesian methods quantify uncertainty through posterior and predictive distributions, but it is difficult to rapidly estimate summaries of these…

Computation · Statistics 2016-12-28 Cheng Li , Sanvesh Srivastava , David B. Dunson

Inference for prediction errors is critical in time series forecasting pipelines. However, providing statistically meaningful uncertainty intervals for prediction errors remains relatively under-explored. Practitioners often resort to…

Methodology · Statistics 2023-09-15 Hui Xu , Song Mei , Stephen Bates , Jonathan Taylor , Robert Tibshirani

This is an earlier, but more general, version of "An L^1 Ergodic Theorem for Sparse Random Subsequences". We prove an L^1 ergodic theorem for averages defined by independent random selector variables, in a setting of general…

Dynamical Systems · Mathematics 2008-12-17 Patrick LaVictoire

Let $X_n$ be a discrete time Markov chain with state space $S$ (countably infinite, in general) and initial probability distribution $\mu^{(0)} = (P(X_0=i_1),P(X_0=i_2),\cdots,)$. What is the probability of choosing in random some $k \in…

Probability · Mathematics 2017-08-01 Nikolaos Halidias

The estimation of a probability p from repeated Bernoulli trials is considered in this paper. A sequential approach is followed, using a simple stopping rule. A closed-form expression and an upper bound are obtained for the mean absolute…

Statistics Theory · Mathematics 2018-12-19 Luis Mendo

A classical method for risk-sensitive nonlinear control is the iterative linear exponential quadratic Gaussian algorithm. We present its convergence analysis from a first-order optimization viewpoint. We identify the objective that the…

Optimization and Control · Mathematics 2019-10-21 Vincent Roulet , Maryam Fazel , Siddhartha Srinivasa , Zaid Harchaoui

We investigate the moment estimation for an ergodic diffusion process with unknown trend coefficient. We consider nonparametric and parametric estimation. In each case, we present a lower bound for the risk and then construct an…

Statistics Theory · Mathematics 2011-11-10 Yury A. Kutoyants , Nakahiro Yoshida

In this paper, we derive asymptotic results for L^1-Wasserstein distance between the distribution function and the corresponding empirical distribution function of a stationary sequence. Next, we give some applications to dynamical systems…

Probability · Mathematics 2008-12-16 Sophie Dede

This paper presents a novel approach for approximate integration over the uncertainty of noise and signal variances in Gaussian process (GP) regression. Our efficient and straightforward approach can also be applied to integration over…

Machine Learning · Statistics 2017-12-18 Ville Tolvanen , Pasi Jylänki , Aki Vehtari

We seek to narrow the gap between parametric and nonparametric modelling of stationary time series processes. The approach is inspired by recent advances in focused inference and model selection techniques. The paper generalises and extends…

Methodology · Statistics 2026-02-20 Gudmund Hermansen , Nils Lid Hjort , Martin Jullum

We develop a nonparametric extension of the sequential generalized likelihood ratio (GLR) test and corresponding time-uniform confidence sequences for the mean of a univariate distribution. By utilizing a geometric interpretation of the GLR…

Statistics Theory · Mathematics 2021-05-17 Jaehyeok Shin , Aaditya Ramdas , Alessandro Rinaldo

The Birkhoff Ergodic Theorem concludes that time averages, that is, Birkhoff averages, $\Sigma_{n=1}^N f(x_n)/N$ of a function $f$ along an ergodic trajectory $(x_n)$ of a function $T$ converges to the space average $\int f d\mu$, where…

Dynamical Systems · Mathematics 2015-08-04 Suddhasattwa Das , Yoshitaka Saiki , Evelyn Sander , James A. Yorke

In this paper, we consider the estimation and inference of precision matrices of a rich class of locally stationary and nonlinear time series assuming that only one realization of the time series is observed. Using a Cholesky decomposition…

Statistics Theory · Mathematics 2019-08-15 Xiucai Ding , Zhou Zhou

In computational inverse problems, it is common that a detailed and accurate forward model is approximated by a computationally less challenging substitute. The model reduction may be necessary to meet constraints in computing time when…

Methodology · Statistics 2018-02-14 Daniela Calvetti , Matthew M. Dunlop , Erkki Somersalo , Andrew M. Stuart

We propose an extended forward-backward algorithm for approximating a zero of a maximal monotone operator which can be split as the extended sum of two maximal monotone operators. We establish the weak convergence in average of the sequence…

Optimization and Control · Mathematics 2013-06-25 Marc Lassonde , Ludovic Nagesseur

We describe and experimentally investigate a method to construct forecasting algorithms for stationary and ergodic processes based on universal measures (or so-called universal data compressors). Using some geophysical and economical time…

Information Theory · Computer Science 2011-04-13 Boris Ryabko , Pavel Pristavka

Early classification of time series has been extensively studied for minimizing class prediction delay in time-sensitive applications such as healthcare and finance. A primary task of an early classification approach is to classify an…

Machine Learning · Computer Science 2020-10-19 Ashish Gupta , Hari Prabhat Gupta , Bhaskar Biswas , Tanima Dutta