English
Related papers

Related papers: Asymptotic equivalence for nonparametric regressio…

200 papers

We propose a theoretical understanding of neural networks in terms of Wilsonian effective field theory. The correspondence relies on the fact that many asymptotic neural networks are drawn from Gaussian processes, the analog of…

Machine Learning · Computer Science 2021-03-16 James Halverson , Anindita Maiti , Keegan Stoner

Most results in nonparametric regression theory are developed only for the case of additive noise. In such a setting many smoothing techniques including wavelet thresholding methods have been developed and shown to be highly adaptive. In…

Statistics Theory · Mathematics 2010-10-20 Lawrence D. Brown , T. Tony Cai , Harrison H. Zhou

This paper develops asymptotic theory for estimation of parameters in regression models for binomial response time series where serial dependence is present through a latent process. Use of generalized linear model (GLM) estimating…

Statistics Theory · Mathematics 2016-06-06 W. T. M. Dunsmuir , J. Y. He

We investigate a semiparametric regression model where one gets noisy non linear non invertible functions of the observations. We focus on the application to bearings-only tracking. We first investigate the least squares estimator and prove…

Statistics Theory · Mathematics 2008-12-17 Elisabeth Gassiat , Benoit Landelle

In this paper we study the asymptotic behavior of linear processes having as innovations mean zero, square integrable functions of stationary reversible Markov chains. In doing so we shall preserve the generality of coefficients assuming…

Probability · Mathematics 2012-06-05 Magda Peligrad

Quantile- and copula-related spectral concepts recently have been considered by various authors. Those spectra, in their most general form, provide a full characterization of the copulas associated with the pairs $(X_t,X_{t-k})$ in a…

Statistics Theory · Mathematics 2016-03-31 Tobias Kley , Stanislav Volgushev , Holger Dette , Marc Hallin

We provide exact asymptotic expressions for the performance of regression by an $L-$layer deep random feature (RF) model, where the input is mapped through multiple random embedding and non-linear activation functions. For this purpose, we…

Machine Learning · Statistics 2023-02-14 David Bosch , Ashkan Panahi , Babak Hassibi

We consider the problem of estimating the predictive density of future observations from a non-parametric regression model. The density estimators are evaluated under Kullback--Leibler divergence and our focus is on establishing the exact…

Statistics Theory · Mathematics 2010-10-12 Xinyi Xu , Feng Liang

We consider nonparametric testing in a non-asymptotic framework. Our statistical guarantees are exact in the sense that Type I and II errors are controlled for any finite sample size. Meanwhile, one proposed test is shown to achieve minimax…

Statistics Theory · Mathematics 2017-02-07 Yun Yang , Zuofeng Shang , Guang Cheng

Statistical physics approaches can be used to derive accurate predictions for the performance of inference methods learning from potentially noisy data, as quantified by the learning curve defined as the average error versus number of…

Machine Learning · Statistics 2012-11-07 Matthew J. Urry , Peter Sollich

We consider the problem of detecting and quantifying the periodic component of a function given noise-corrupted observations of a limited number of input/output tuples. Our approach is based on Gaussian process regression which provides a…

Statistics Theory · Mathematics 2016-08-22 Nicolas Durrande , James Hensman , Magnus Rattray , Neil D. Lawrence

Despite the ubiquity of the Gaussian process regression model, few theoretical results are available that account for the fact that parameters of the covariance kernel typically need to be estimated from the dataset. This article provides…

Statistics Theory · Mathematics 2020-05-12 Toni Karvonen , George Wynne , Filip Tronarp , Chris J. Oates , Simo Särkkä

Quantum Markov models are employed ubiquitously in quantum physics and in quantum information theory due to their relative simplicity and analytical tractability. In particular, these models are known to give accurate approximations for a…

Quantum Physics · Physics 2024-02-02 Hendra I. Nurdin

We address the problem of learning an unknown smooth function and its derivatives from noisy pointwise evaluations under the supremum norm. While classical nonparametric regression provides a strong theoretical foundation, traditional…

Machine Learning · Computer Science 2026-03-10 Davide Maran , Marcello Restelli

By using the algebraic construction outlined in \cite{CGRS}, we introduce several Markov processes related to the ${\mathcal{U}}_q(\mathfrak{su}(1,1))$ quantum Lie algebra. These processes serve as asymmetric transport models and their…

Probability · Mathematics 2016-03-23 Gioia Carinci , Cristian Giardina' , Frank Redig , Tomohiro Sasamoto

Doubly robust estimators have gained widespread popularity in various fields due to their ability to provide unbiased estimates under model misspecification. However, the asymptotic theory for doubly robust estimators with continuous-time…

Statistics Theory · Mathematics 2024-04-23 Andrew Ying

In this article we consider the nonparametric robust estimation problem for regression models in continuous time with semi-Markov noises observed in discrete time moments. An adaptive model selection procedure is proposed. A sharp…

Statistics Theory · Mathematics 2020-05-15 Vlad Stefan Barbu , Slim Beltaief , Serguei Pergamenshchikov

In the context of non-Gaussian analysis, Schneider [27] introduced grey noise measures, built upon Mittag-Leffler functions; analogously, grey Brownian motion and its generalizations were constructed (see, for example, [25], [6], [7], [8]).…

Probability · Mathematics 2022-07-28 Luisa Beghin , Lorenzo Cristofaro , Janusz Gajda

Linear regression on network-linked observations has been an essential tool in modeling the relationship between response and covariates with additional network structures. Previous methods either lack inference tools or rely on restrictive…

Methodology · Statistics 2022-08-22 Can M. Le , Tianxi Li

We find the asymptotic distribution of the multi-dimensional multi-scale and kernel estimators for high-frequency financial data with microstructure. Sampling times are allowed to be asynchronous and endogenous. In the process, we show that…

Statistics Theory · Mathematics 2014-11-05 Markus Bibinger , Per A. Mykland