English
Related papers

Related papers: Guessing the output of a stationary binary time se…

200 papers

Let $(B(t))_{t\in \Theta}$ with $\Theta={\mathbb Z}$ or $\Theta={\mathbb R}$ be a wide sense stationary process with discrete or continuous time. The classical linear prediction problem consists of finding an element in…

Probability · Mathematics 2020-02-07 Ildar Ibragimov , Zakhar Kabluchko , Mikhail Lifshits

Consider the following prediction problem. Assume that there is a block box that produces bits according to some unknown computable distribution on the binary tree. We know first $n$ bits $x_1 x_2 \ldots x_n$. We want to know the…

Information Theory · Computer Science 2023-08-25 Alexey Milovanov

Let $(X_n:n\ge 1)$ be a sequence of random observations. Let $\sigma_n(\cdot)=P\bigl(X_{n+1}\in\cdot\mid X_1,\ldots,X_n\bigr)$ be the $n$-th predictive distribution and $\sigma_0(\cdot)=P(X_1\in\cdot)$ the marginal distribution of $X_1$. In…

Statistics Theory · Mathematics 2021-04-27 Patrizia Berti , Emanuela Dreassi , Fabrizio Leisen , Pietro Rigo , Luca Pratelli

When analysing time series an important issue is to decide whether the time series is stationary or a random walk. Relaxing these notions, we consider the problem to decide in favor of the I(0)- or I(1)-property. Fixed-sample statistical…

Statistics Theory · Mathematics 2018-05-01 Ansgar Steland

This paper addresses the prediction of stationary functional time series. Existing contributions to this problem have largely focused on the special case of first-order functional autoregressive processes because of their technical…

Methodology · Statistics 2014-04-01 Alexander Aue , Diogo Dubart Norinho , Siegfried Hörmann

The problem of sequential probability forecasting is considered in the most general setting: a model set C is given, and it is required to predict as well as possible if any of the measures (environments) in C is chosen to generate the…

Machine Learning · Computer Science 2019-10-25 Daniil Ryabko

We study the problem of finding an universal estimation scheme $h_n:\mathbb{R}^n\to \mathbb{R}$, $n=1,2,...$ which will satisfy \lim_{t\rightarrow\infty}{\frac{1}{t}}\sum_{i=1}^t|h_ i(X_0,X_1,...,X_{i-1})-E(X_i|X_0,X_1,...,X_{i-1})|^p=0…

Probability · Mathematics 2011-04-11 Gusztáv Morvai , Benjamin Weiss

We present online prediction methods for time series that let us explicitly handle nonstationary artifacts (e.g. trend and seasonality) present in most real time series. Specifically, we show that applying appropriate transformations to…

Machine Learning · Statistics 2018-08-28 Christopher Xie , Avleen Bijral , Juan Lavista Ferres

We consider the problem of inference for non-stationary time series with heavy-tailed error distribution. Under a time-varying linear process framework we show that there exists a suitable local approximation by a stationary process with…

Statistics Theory · Mathematics 2024-07-09 Fumiya Akashi , Konstantinos Fokianos , Junichi Hirukawa

This paper studies the problem of recursively estimating the weighted adjacency matrix of a network out of a temporal sequence of binary-valued observations. The observation sequence is generated from nonlinear networked dynamics in which…

Systems and Control · Electrical Eng. & Systems 2019-12-06 Yu Xing , Xingkang He , Haitao Fang , Karl Henrik Johansson

The probability of observing $x_t$ at time $t$, given past observations $x_1...x_{t-1}$ can be computed with Bayes' rule if the true generating distribution $\mu$ of the sequences $x_1x_2x_3...$ is known. If $\mu$ is unknown, but known to…

Machine Learning · Computer Science 2016-11-18 Marcus Hutter

The conditional distribution of the next outcome given the infinite past of a stationary process can be inferred from finite but growing segments of the past. Several schemes are known for constructing pointwise consistent estimates, but…

Statistics Theory · Mathematics 2016-11-17 G. Morvai , S. Yakowitz , P. Algoet

We present data-dependent learning bounds for the general scenario of non-stationary non-mixing stochastic processes. Our learning guarantees are expressed in terms of a data-dependent measure of sequential complexity and a discrepancy…

Machine Learning · Computer Science 2018-03-16 Vitaly Kuznetsov , Mehryar Mohri

Solomonoff's uncomputable universal prediction scheme $\xi$ allows to predict the next symbol $x_k$ of a sequence $x_1...x_{k-1}$ for any Turing computable, but otherwise unknown, probabilistic environment $\mu$. This scheme will be…

Machine Learning · Computer Science 2007-05-23 Marcus Hutter

Observing a stationary time series, we propose a two-step procedure for the prediction of the next value of the time series. The first step follows machine learning theory paradigm and consists in determining a set of possible predictors as…

Methodology · Statistics 2012-07-04 Pierre Alquier , Olivier Wintenberger

The setting is a stationary, ergodic time series. The challenge is to construct a sequence of functions, each based on only finite segments of the past, which together provide a strongly consistent estimator for the conditional probability…

Probability · Mathematics 2008-06-19 G. Morvai , S. Yakowitz , L. Gyorfi

In this paper we address the statistical problem of testing if a stationary process is Gaussian. The observation consists in a finite sample path of the process. Using a random projection technique introduced and studied in Cuesta-Albertos…

Methodology · Statistics 2009-11-19 Juan . A. Cuesta-Albertos , Fabrice Gamboa Alicia Nieto-Reyes

We introduce a Gaussian process-based model for handling of non-stationarity. The warping is achieved non-parametrically, through imposing a prior on the relative change of distance between subsequent observation inputs. The model allows…

Machine Learning · Statistics 2019-12-06 David Tolpin

The following learning problem arises naturally in various applications: Given a finite sample from a categorical or count time series, can we learn a function of the sample that (nearly) maximizes the probability of correctly guessing the…

Statistics Theory · Mathematics 2026-05-27 J. -R. Chazottes , S. Gallo , D. Takahashi

We consider the Bayesian optimal filtering problem: i.e. estimating some conditional statistics of a latent time-series signal from an observation sequence. Classical approaches often rely on the use of assumed or estimated transition and…

Machine Learning · Statistics 2023-03-16 Adrian N. Bishop , Edwin V. Bonilla