English
Related papers

Related papers: A new kernel-based approach for spectral estimatio…

200 papers

We provide new general kernel selection rules thanks to penalized least-squares criteria. We derive optimal oracle inequalities using adequate concentration tools. We also investigate the problem of minimal penalty as described in [BM07].

Statistics Theory · Mathematics 2015-11-09 M Lerasle , N Magalhães , P Reynaud-Bouret

Estimating the innovation probability density is an important issue in any regression analysis. This paper focuses on functional autoregressive models. A residual-based kernel estimator is proposed for the innovation density. Asymptotic…

Methodology · Statistics 2010-05-07 Nadine Hilgert , Bruno Portier

The kernel polynomial method (KPM) is a powerful numerical method for approximating spectral densities. Typical implementations of the KPM require an a prior estimate for an interval containing the support of the target spectral density,…

Computational Physics · Physics 2023-09-19 Tyler Chen

We explore a method of statistical estimation called Maximum Entropy on the Mean (MEM) which is based on an information-driven criterion that quantifies the compliance of a given point with a reference prior probability measure. At the core…

Statistics Theory · Mathematics 2022-12-20 Yakov Vaisbourd , Rustum Choksi , Ariel Goodwin , Tim Hoheisel , Carola-Bibiane Schönlieb

Spectral risk measures (SRMs) belong to the family of coherent risk measures. A natural estimator for the class of SRMs has the form of L-statistics. Various authors have studied and derived the asymptotic properties of the empirical…

Statistical Finance · Quantitative Finance 2023-12-11 Suparna Biswas , Rituparna Sen

In data science, individual observations are often assumed to come independently from an underlying probability space. Kernel matrices formed from large sets of such observations arise frequently, for example during classification tasks. It…

Machine Learning · Statistics 2026-05-27 Mikhail Lepilov

This study proposes a data condensation method for multivariate kernel density estimation by genetic algorithm. First, our proposed algorithm generates multiple subsamples of a given size with replacement from the original sample. The…

Methodology · Statistics 2022-03-04 Kiheiji Nishida

Stochastic gradient descent algorithms for training linear and kernel predictors are gaining more and more importance, thanks to their scalability. While various methods have been proposed to speed up their convergence, the model selection…

Machine Learning · Computer Science 2014-06-17 Francesco Orabona

We present a novel scheme to boost detection power for kernel maximum mean discrepancy based sequential change-point detection procedures. Our proposed scheme features an optimal sub-sampling of the history data before the detection…

Methodology · Statistics 2023-01-19 Song Wei , Chaofan Huang

This paper presents a new perspective on the identification at infinity for the intercept of the sample selection model as identification at the boundary via a transformation of the selection index. This perspective suggests generalizations…

Econometrics · Economics 2023-02-13 Zhewen Pan

We investigate the asymptotic mean squared error of kernel estimators of the intensity function of a spatial point process. We show that when $n$ independent copies of a point process in $\mathbb R^d$ are superposed, the optimal bandwidth…

Statistics Theory · Mathematics 2019-04-11 M. N. M. van Lieshout

Analyzing the structure of sampled features from an input data distribution is challenging when constrained by limited measurements in both the number of inputs and features. Traditional approaches often rely on the eigenvalue spectrum of…

Machine Learning · Computer Science 2025-02-11 Chanwoo Chun , SueYeon Chung , Daniel D. Lee

Error entropy is a important nonlinear similarity measure, and it has received increasing attention in many practical applications. The default kernel function of error entropy criterion is Gaussian kernel function, however, which is not…

Signal Processing · Electrical Eng. & Systems 2023-09-06 Jiacheng He , Gang Wang , Bei Peng , Zhenyu Feng , Kun Zhang

This paper studies the use of kernel density estimation (KDE) for linear algebraic tasks involving the kernel matrix of a collection of $n$ data points in $\mathbb R^d$. In particular, we improve upon existing algorithms for computing the…

Data Structures and Algorithms · Computer Science 2026-03-05 Rikhav Shah , Sandeep Silwal , Haike Xu

In this paper, we deal with nonparametric regression for circular data, meaning that observations are represented by points lying on the unit circle. We propose a kernel estimation procedure with data-driven selection of the bandwidth…

Statistics Theory · Mathematics 2023-07-03 Tien Dat Nguyen , Thanh Mai Pham Ngoc , Vincent Rivoirard

Recent contributions have framed linear system identification as a nonparametric regularized inverse problem. Relying on $\ell_2$-type regularization which accounts for the stability and smoothness of the impulse response to be estimated,…

Systems and Control · Computer Science 2016-09-30 Giulia Prando , Gianluigi Pillonetto , Alessandro Chiuso

This paper proposes a novel kernel-based optimization scheme to handle tasks in the analysis, e.g., signal spectral estimation and single-channel source separation of 1D non-stationary oscillatory data. The key insight of our optimization…

Machine Learning · Statistics 2022-12-12 Jieren Xu , Yitong Li , Haizhao Yang , David Dunson , Ingrid Daubechies

In order to clarify the statistical features of complex networks, the spectral density of adjacency matrices has often been investigated. Adopting a static model introduced by Goh, Kahng and Kim, we analyse the spectral density of complex…

Statistical Mechanics · Physics 2009-11-13 Taro Nagao , G. J. Rodgers

This paper introduces a kernel discrepancy-based framework for rerandomization to enhance the precision of causal inference in controlled experiments. We demonstrate that the kernel discrepancy is the key part of the variance upper bound…

Methodology · Statistics 2025-11-05 Yiou Li , Lulu Kang

We study fast algorithms for computing fundamental properties of a positive semidefinite kernel matrix $K \in \mathbb{R}^{n \times n}$ corresponding to $n$ points $x_1,\ldots,x_n \in \mathbb{R}^d$. In particular, we consider estimating the…

Data Structures and Algorithms · Computer Science 2021-06-21 Arturs Backurs , Piotr Indyk , Cameron Musco , Tal Wagner