English
Related papers

Related papers: Nonparametric estimation in a semimartingale regre…

200 papers

We analyze the practices of reservoir computing in the framework of statistical learning theory. In particular, we derive finite sample upper bounds for the generalization error committed by specific families of reservoir computing systems…

Machine Learning · Computer Science 2019-10-31 Lukas Gonon , Lyudmila Grigoryeva , Juan-Pablo Ortega

We analyse the prediction error of principal component regression (PCR) and prove non-asymptotic upper bounds for the corresponding squared risk. Under mild assumptions, we show that PCR performs as well as the oracle method obtained by…

Statistics Theory · Mathematics 2019-04-17 Martin Wahl

In this paper we formulate a solution of the robust linear regression problem in a general framework of correntropy maximization. Our formulation yields a unified class of estimators which includes the Gaussian and Laplacian kernel-based…

Systems and Control · Computer Science 2017-09-04 Laurent Bako

The subject of robust estimation in time series is widely discussed in literature. One of the approaches is to use GM-estimation. This method incorporates a broad class of nonparametric estimators which under suitable conditions includes…

Statistics Theory · Mathematics 2007-06-13 Alexander Alekseev

We consider the robust adaptive nonparametric estimation problem for a periodic function observed in the framework of a continuous time regression model with semimartingale noises.

Statistics Theory · Mathematics 2020-05-26 Evgeny A. Pchelintsev , Serguei M. Pergamenshchikov , Maria A. Povzun

Cox proportional hazards model with measurement error is investigated. In Kukush et al. (2011) [Journal of Statistical Research 45, 77-94] and Chimisov and Kukush (2014) [Modern Stochastics: Theory and Applications 1, 13-32] asymptotic…

Statistics Theory · Mathematics 2017-04-03 Alexander Kukush , Oksana Chernova

We construct efficient robust truncated sequential estimators for the pointwise estimation problem in nonparametric autoregression models with smooth coefficients. For Gaussian models we propose an adaptive procedure based on the…

Statistics Theory · Mathematics 2013-04-18 Ouerdia Arkoun , Serguei Pergamenchtchikov

Doubly robust estimators have gained widespread popularity in various fields due to their ability to provide unbiased estimates under model misspecification. However, the asymptotic theory for doubly robust estimators with continuous-time…

Statistics Theory · Mathematics 2024-04-23 Andrew Ying

We study the problem of signal source localization using received signal strength measurements. We begin by presenting verifiable geometric conditions for sensor deployment that ensure the model's asymptotic localizability. Then we…

Systems and Control · Electrical Eng. & Systems 2025-05-20 Shenghua Hu , Guangyang Zeng , Wenchao Xue , Haitao Fang , Junfeng Wu , Biqiang Mu

We prove some efficient inference results concerning estimation of a Ornstein-Uhlenbeck regression model, which is driven by a non-Gaussian stable Levy process and where the output process is observed at high-frequency over a fixed time…

Statistics Theory · Mathematics 2023-01-18 Hiroki Masuda

We study learning of probability distributions characterized by an unknown symmetry direction. Based on an entropic performance measure and the variational method of statistical mechanics we develop exact upper and lower bounds on the…

Disordered Systems and Neural Networks · Physics 2009-11-07 D. Herschkowitz , M. Opper

We consider estimation and inference in a single index regression model with an unknown convex link function. We introduce a convex and Lipschitz constrained least squares estimator (CLSE) for both the parametric and the nonparametric…

Statistics Theory · Mathematics 2021-01-15 Arun K. Kuchibhotla , Rohit K. Patra , Bodhisattva Sen

For the zone of moderate deviation probabilities the local asymptotic minimax lower bound of asymptotic efficiency of estimators is established. The estimation parameter is multidimensional. The lower bound admits the interpretation as the…

Statistics Theory · Mathematics 2012-06-08 Mikhail Ermakov

A two-class mixture model, where the density of one of the components is known, is considered. We address the issue of the nonparametric adaptive estimation of the unknown probability density of the second component. We propose a randomly…

Statistics Theory · Mathematics 2021-02-08 Gaelle Chagny , Antoine Channarond , Van Ha Hoang , Angelina Roche

The semiparametric estimation approach, which includes inverse-probability-weighted and doubly robust estimation using propensity scores, is a standard tool in causal inference, and it is rapidly being extended in various directions. On the…

Methodology · Statistics 2022-12-29 Takamichi Baba , Yoshiyuki Ninomiya

In this paper, we establish minimax optimal rates of convergence for prediction in a semi-functional linear model that consists of a functional component and a less smooth nonparametric component. Our results reveal that the smoother…

Statistics Theory · Mathematics 2021-11-01 Keli Guo , Jun Fan , Lixing Zhu

It is widely admitted that structured nonparametric modeling that circumvents the curse of dimensionality is important in nonparametric estimation. In this paper we show that the same holds for semi-parametric estimation. We argue that…

Statistics Theory · Mathematics 2011-04-25 Kyusang Yu , Enno Mammen , Byeong U. Park

This work examines risk bounds for nonparametric distributional regression estimators. For convex-constrained distributional regression, general upper bounds are established for the continuous ranked probability score (CRPS) and the…

While robust divergence such as density power divergence and $\gamma$-divergence is helpful for robust statistical inference in the presence of outliers, the tuning parameter that controls the degree of robustness is chosen in a…

Methodology · Statistics 2021-09-15 Shonosuke Sugasawa , Shouto Yonekura

Non-conservative uncertainty bounds are key for both assessing an estimation algorithm's accuracy and in view of downstream tasks, such as its deployment in safety-critical contexts. In this paper, we derive a tight, non-asymptotic…

Machine Learning · Computer Science 2026-01-16 Amon Lahr , Johannes Köhler , Anna Scampicchio , Melanie N. Zeilinger