English
Related papers

Related papers: Large Spectral Density Matrix Estimation by Thresh…

200 papers

The estimation of a density profile from experimental data points is a challenging problem, usually tackled by plotting a histogram. Prior assumptions on the nature of the density, from its smoothness to the specification of its form, allow…

Methodology · Statistics 2015-03-13 Alberto Bernacchia , Simone Pigolotti

Covariance function estimation is a fundamental task in multivariate functional data analysis and arises in many applications. In this paper, we consider estimating sparse covariance functions for high-dimensional functional data, where the…

Statistics Theory · Mathematics 2022-07-15 Qin Fang , Shaojun Guo , Xinghao Qiao

The density function of the limiting spectral distribution of general sample covariance matrices is usually unknown. We propose to use kernel estimators which are proved to be consistent. A simulation study is also conducted to show the…

Statistics Theory · Mathematics 2012-11-15 Bing-Yi Jing , Guangming Pan , Qi-Man Shao , Wang Zhou

Transformer-based large language models (LLMs) are comprised of billions of parameters arranged in deep and wide computational graphs. Several studies on LLM efficiency optimization argue that it is possible to prune a significant portion…

Computation and Language · Computer Science 2026-04-16 Corentin Kervadec , Iuliia Lysova , Marco Baroni , Gemma Boleda

The ratio between two probability density functions is an important component of various tasks, including selection bias correction, novelty detection and classification. Recently, several estimators of this ratio have been proposed. Most…

Methodology · Statistics 2014-04-30 Rafael Izbicki , Ann B. Lee , Chad M. Schafer

Conditional density estimation is a general framework for solving various problems in machine learning. Among existing methods, non-parametric and/or kernel-based methods are often difficult to use on large datasets, while methods based on…

Machine Learning · Statistics 2018-06-06 Hiroaki Sasaki , Aapo Hyvärinen

Machine-learned regression models represent a promising tool to implement accurate and computationally affordable energy-density functionals to solve quantum many-body problems via density functional theory. However, while they can easily…

Computational Physics · Physics 2022-11-08 Emanuele Costa , Giuseppe Scriva , Rosario Fazio , Sebastiano Pilati

This paper provides the relevant literature with a complete toolkit for conducting robust estimation and inference about the parameters of interest involved in a high-dimensional panel data framework. Specifically, (1) we allow for…

Econometrics · Economics 2025-02-13 Jiti Gao , Fei Liu , Bin Peng , Yayi Yan

We propose a test of many zero parameter restrictions in a high dimensional linear iid regression model with $k$ $>>$ $n$ regressors. The test statistic is formed by estimating key parameters one at a time based on many low dimension…

Statistics Theory · Mathematics 2023-12-12 Jonathan B. Hill

We derive the exact form of the eigenvalue spectra of correlation matrices derived from a set of time-shifted, finite Brownian random walks (time-series). These matrices can be seen as random, real, asymmetric matrices with a special…

Physics and Society · Physics 2008-12-02 Christoly Biely , Stefan Thurner

Exact eigendecomposition of large matrices is very expensive, and it is practically impossible to compute exact eigenvalues. Instead, one may set a more modest goal of approaching the empirical distribution of the eigenvalues, recovering…

Frequency estimation is a fundamental problem in signal processing, with applications in radar imaging, underwater acoustics, seismic imaging, and spectroscopy. The goal is to estimate the frequency of each component in a multisinusoidal…

Machine Learning · Computer Science 2021-02-04 Gautier Izacard , Sreyas Mohan , Carlos Fernandez-Granda

We compute the spectral density for ensembles of of sparse symmetric random matrices using replica, managing to circumvent difficulties that have been encountered in earlier approaches along the lines first suggested in a seminal paper by…

Disordered Systems and Neural Networks · Physics 2009-11-13 Reimer Kuehn

An important problem in space-time adaptive detection is the estimation of the large p-by-p interference covariance matrix from training signals. When the number of training signals n is greater than 2p, existing estimators are generally…

Signal Processing · Electrical Eng. & Systems 2021-07-26 Benjamin D. Robinson , Robert Malinas , Alfred O. Hero

Existing frequency domain methods for bootstrapping time series have a limited range. Consider for instance the class of spectral mean statistics (also called integrated periodograms) which includes many important statistics in time series…

Methodology · Statistics 2018-06-19 Marco Meyer , Efstathios Paparoditis , Jens-Peter Kreiss

One of the fundamental problems in machine learning is the estimation of a probability distribution from data. Many techniques have been proposed to study the structure of data, most often building around the assumption that observations…

Machine Learning · Statistics 2013-02-22 Oren Rippel , Ryan Prescott Adams

We propose a novel estimation framework for quadratic functionals of precision matrices in high-dimensional settings, particularly in regimes where the feature dimension $p$ exceeds the sample size $n$. Traditional moment-based estimators…

Methodology · Statistics 2026-01-08 Shizhe Hong , Weiming Li , Guangming Pan

In this article, we derive concentration inequalities for the spectral norm of two classical sample estimators of large dimensional Toeplitz covariance matrices, demonstrating in particular their asymptotic almost sure consistence. The…

Information Theory · Computer Science 2015-10-28 Julia Vinogradova , Romain Couillet , Walid Hachem

Signal decomposition and multiscale signal analysis provide many useful tools for time-frequency analysis. We proposed a random feature method for analyzing time-series data by constructing a sparse approximation to the spectrogram. The…

Signal Processing · Electrical Eng. & Systems 2023-03-17 Nicholas Richardson , Hayden Schaeffer , Giang Tran

This article introduces the class of continuous time locally stationary wavelet processes. Continuous time models enable us to properly provide scale-based time series models for irregularly-spaced observations for the first time, while…

Statistics Theory · Mathematics 2025-03-19 Henry Antonio Palasciano , Marina I. Knight , Guy P. Nason