English
Related papers

Related papers: A new kernel-based approach for spectral estimatio…

200 papers

We introduce a data-based approach to estimating key quantities which arise in the study of nonlinear control systems and random nonlinear dynamical systems. Our approach hinges on the observation that much of the existing linear theory may…

Optimization and Control · Mathematics 2016-04-04 Jake Bouvrie , Boumediene Hamzi

The paper deals with the nonparametric estimation problem at a given fixed point for an autoregressive model with unknown distributed noise. Kernel estimate modifications are proposed. Asymptotic minimax and efficiency properties for…

Statistics Theory · Mathematics 2008-06-19 Ouerdia Arkoun , Serguei Pergamenchtchikov

Estimation of autocorrelations and spectral densities is of fundamental importance in many fields of science, from identifying pulsar signals in astronomy to measuring heart beats in medicine. In circumstances where one is interested in…

Methodology · Statistics 2013-01-22 C. H. Fleming , J. M. Calabrese

It is possible to approach regression analysis with random covariates from a semiparametric perspective where information is combined from multiple multivariate sources. The approach assumes a semiparametric density ratio model where…

Methodology · Statistics 2012-10-02 Anastasia Voulgaraki , Benjamin Kedem , Barry I. Graubard

We address the problem of density estimation with $\mathbb{L}_s$-loss by selection of kernel estimators. We develop a selection procedure and derive corresponding $\mathbb{L}_s$-risk oracle inequalities. It is shown that the proposed…

Statistics Theory · Mathematics 2012-11-26 Alexander Goldenshluger , Oleg Lepski

Several strategies have been developed recently to ensure valid inference after model selection; some of these are easy to compute, while others fare better in terms of inferential power. In this paper, we consider a selective inference…

Methodology · Statistics 2022-07-13 Snigdha Panigrahi , Jonathan Taylor

It is well known that kernel ridge regression (KRR) is a popular nonparametric regression estimator. Nonetheless, in the presence of a large data set with size $n\gg 1,$ the KRR estimator has the drawback to require an intensive…

Statistics Theory · Mathematics 2023-01-19 Asma Ben Saber , Abderrazek Karoui

This paper investigates the problem of estimating the spectral power parameters of random analog sources using numerical measurements acquired with minimum digitization complexity. Therefore, spectral analysis has to be performed with…

Signal Processing · Electrical Eng. & Systems 2019-10-29 Manuel S. Stein

Local polynomial regression of order at least one often performs poorly in regions of sparse data. Local constant regression is exceptional in this regard, though it is the least accurate method in general, especially at the boundaries of…

Methodology · Statistics 2024-06-18 Chunlei Ge , W. John Braun

A new likelihood based AR approximation is given for ARMA models. The usual algorithms for the computation of the likelihood of an ARMA model require $O(n)$ flops per function evaluation. Using our new approximation, an algorithm is…

Statistics Theory · Mathematics 2016-11-04 A. Ian McLeod , Ying Zhang

Spectrum sensing is a key problem in cognitive radio. However, traditional detectors become ineffective when noise uncertainty is severe. It is shown that the entropy of Gauss white noise is constant in the frequency domain, and a robust…

Information Theory · Computer Science 2011-10-03 Nan Zhao

In adaptive control theory, the dynamic regressor extension and mixing (DREM) procedure has become widespread as it allows one to describe major of adaptive control problems in unified terms of the parameter estimation problem of a…

Systems and Control · Electrical Eng. & Systems 2024-12-12 Anton Glushchenko , Konstantin Lastochkin

As a promising step, the performance of data analysis and feature learning are able to be improved if certain pattern matching mechanism is available. One of the feasible solutions can refer to the importance estimation of instances, and…

Machine Learning · Computer Science 2020-11-17 Miao Cheng , Xinge You

Providing non-conservative uncertainty quantification for function estimates derived from noisy observations remains a fundamental challenge in statistical machine learning, particularly for applications in safety-critical domains. In this…

Machine Learning · Computer Science 2026-05-12 Johannes Teutsch , Oleksii Molodchyk , Marion Leibold , Timm Faulwasser , Armin Lederer

We give the cumulative distribution function of $M_n$, the maximum of a sequence of $n$ observations from an ARMA(1, 1) process. Solutions are first given in terms of repeated integrals and then for the case, where the underlying random…

Statistics Theory · Mathematics 2013-12-30 C. S. Withers , S. Nadarajah

A hybrid estimator of the log-spectral density of a stationary time series is proposed. First, a multiple taper estimate is performed, followed by kernel smoothing the log-multitaper estimate. This procedure reduces the expected mean square…

Methodology · Statistics 2020-02-18 Alexander Sidorenko , Kurt S. Riedel

Tree ensembles such as random forests (RFs) and gradient boosting machines (GBMs) are among the most widely used supervised learners, yet their theoretical properties remain incompletely understood. We adopt a spectral perspective on these…

Machine Learning · Statistics 2026-05-13 Binh Duc Vu , David S. Watson

Results from global sensitivity analysis (GSA) often guide the understanding of complicated input-output systems. Kernel-based GSA methods have recently been proposed for their capability of treating a broad scope of complex systems. In…

Methodology · Statistics 2022-08-09 John Barr , Herschel Rabitz

The Gaussian kernel is one of the most important kernels, applicable to many research fields, including scientific computing and data science. In this paper, we present asymptotic analysis of the Gaussian kernel matrix in high dimension…

Statistics Theory · Mathematics 2026-02-11 Kensuke Aishima

Existing permanental processes often impose constraints on kernel types or stationarity, limiting the model's expressiveness. To overcome these limitations, we propose a novel approach utilizing the sparse spectral representation of…

Machine Learning · Statistics 2024-12-20 Zicheng Sun , Yixuan Zhang , Zenan Ling , Xuhui Fan , Feng Zhou