English
Related papers

Related papers: Computational limits to nonparametric estimation f…

200 papers

Given a heterogeneous time-series sample, the objective is to find points in time (called change points) where the probability distribution generating the data has changed. The data are assumed to have been generated by arbitrary unknown…

Machine Learning · Statistics 2015-05-13 Azadeh Khaleghi , Daniil Ryabko

We consider the problem of estimating the context tree of a stationary ergodic process with finite alphabet without imposing additional conditions on the process. As a starting point we introduce a Hamming metric in the space of irreducible…

Statistics Theory · Mathematics 2015-08-21 Sandro Gallo , Florencia Leonardi

This study concerns problems of time-series forecasting under the weakest of assumptions. Related results are surveyed and are points of departure for the developments here, some of which are new and others are new derivations of previous…

Probability · Mathematics 2016-11-17 L. Gyorfi , G. Morvai , S. Yakowitz

In this paper we consider the nonparametric estimation of density and regression functions with non-negative support using a gamma kernel procedure introduced by Chen (2000). Strong uniform consistency and asymptotic normality of the…

Statistics Theory · Mathematics 2016-10-18 A. C. Rosa , M. E. Nogueira

In this paper, we are interested in nonparametric kernel estimation of a generalized regression function, including conditional cumulative distribution and conditional quantile functions, based on an incomplete sample $(X_t, Y_t,…

Statistics Theory · Mathematics 2021-10-19 Mohamed Chaouch , Naâmane Laïb

We derive new inequalities for the probabilities of projective measurements in mutually unbiased bases of a qudit system. These inequalities lead to wider ranges of validity and tighter bounds on entropic uncertainty inequalities previously…

Quantum Physics · Physics 2009-11-13 Shengjun Wu , Sixia Yu , Klaus Mølmer

The forecasting problem for a stationary and ergodic binary time series $\{X_n\}_{n=0}^{\infty}$ is to estimate the probability that $X_{n+1}=1$ based on the observations $X_i$, $0\le i\le n$ without prior knowledge of the distribution of…

Probability · Mathematics 2008-06-19 Gusztav Morvai , Benjamin Weiss

This paper studies a problem of Bayesian parameter estimation for a sequence of scaled counting processes whose weak limit is a Brownian motion with an unknown drift. The main result of the paper is that the limit of the posterior…

Statistics Theory · Mathematics 2015-03-19 Asaf Cohen

This study considers regression analysis of a circular response with an error-prone linear covariate. Starting with an existing estimator of the circular regression function that assumes error-free covariate, three approaches are proposed…

Methodology · Statistics 2025-08-25 Nicholas Woolsey , Xianzheng Huang

Nonparametric maximum likelihood estimators (MLEs) in inverse problems often have non-normal limit distributions, like Chernoff's distribution. However, if one considers smooth functionals of the model, with corresponding functionals of the…

Statistics Theory · Mathematics 2023-10-24 Piet Groeneboom

We study limit laws for return time processes defined on infinite conservative ergodic measure preserving dynamical systems. Especially for the critical cases with purely atomic limiting distribution we derive distorted processes posessing…

Dynamical Systems · Mathematics 2007-06-20 Marc Kesseböhmer , Mehdi Slassi

We construct ergodic probability measures with infinite metric entropy for typical continuous maps and homeomorphisms on compact manifolds. We also construct sequences of such measures that converge to a zero-entropy measure.

Dynamical Systems · Mathematics 2025-04-15 Eleonora Catsigeras , Serge Troubetzkoy

A set of probabilistic predictions is well calibrated if the events that are predicted to occur with probability p do in fact occur about p fraction of the time. Well calibrated predictions are particularly important when machine learning…

Machine Learning · Statistics 2014-01-14 Mahdi Pakdaman Naeini , Gregory F. Cooper , Milos Hauskrecht

We study the problem of finding an universal estimation scheme $h_n:\mathbb{R}^n\to \mathbb{R}$, $n=1,2,...$ which will satisfy \lim_{t\rightarrow\infty}{\frac{1}{t}}\sum_{i=1}^t|h_ i(X_0,X_1,...,X_{i-1})-E(X_i|X_0,X_1,...,X_{i-1})|^p=0…

Probability · Mathematics 2011-04-11 Gusztáv Morvai , Benjamin Weiss

In this paper we consider the estimation of unknown parameters in Bayesian inverse problems. In most cases of practical interest, there are several barriers to performing such estimation, This includes a numerical approximation of a…

Methodology · Statistics 2025-02-07 Neil K. Chada , Ajay Jasra , Mohamed Maama , Raul Tempone

Assuming that a reflected Ornstein-Uhlenbeck state process is observed at discrete time instants, we propose generalized moment estimators to estimate all drift and diffusion parameters via the celebrated ergodic theorem. With the sampling…

Statistics Theory · Mathematics 2020-09-14 Yaozhong Hu , Yuejuan Xi

A compound Poisson process whose parameters are all unknown is observed at finitely many equispaced times. Nonparametric estimators of the jump and L\'evy distributions are proposed and functional central limit theorems using the uniform…

Statistics Theory · Mathematics 2017-02-06 Alberto J. Coca

We study asymptotic behaviors of Bayes type estimators and give sufficient conditions to obtain asymptotic limit distribution of estimation error. We assume polynomial type large deviation inequalities and prove asymptotic equivalence of…

Statistics Theory · Mathematics 2013-12-31 Teppei Ogihara

Estimation of a quadratic functional over parameter spaces that are not quadratically convex is considered. It is shown, in contrast to the theory for quadratically convex parameter spaces, that optimal quadratic rules are often rate…

Statistics Theory · Mathematics 2007-06-13 T. Tony Cai , Mark G. Low

An adaptive nonparametric estimation procedure is constructed for heteroscedastic regression when the noise variance depends on the unknown regression. A non-asymptotic upper bound for a quadratic risk (oracle inequality) is obtained

Statistics Theory · Mathematics 2010-02-09 Leonid Galtchouk , Serguei Pergamenchtchikov