English
Related papers

Related papers: Spectral Estimators for Structured Generalized Lin…

200 papers

We present a theoretically grounded Gaussian process framework that leverages neural feature maps to construct expressive kernels. We show that the learned feature map can be interpreted as an optimal low-rank approximation to a Gram matrix…

Machine Learning · Statistics 2026-05-12 Anthony Stephenson

The problem of estimating a random vector x from noisy linear measurements y = A x + w with unknown parameters on the distributions of x and w, which must also be learned, arises in a wide range of statistical learning and linear inverse…

Information Theory · Computer Science 2017-06-20 Alyson K. Fletcher , Mojtaba Sahraee-Ardakan , Philip Schniter , Sundeep Rangan

Consider the problem of estimating a low-rank matrix when its entries are perturbed by Gaussian noise. If the empirical distribution of the entries of the spikes is known, optimal estimators that exploit this knowledge can substantially…

Statistics Theory · Mathematics 2019-08-08 Andrea Montanari , Ramji Venkataramanan

We study the problem of passive imaging through convolutive channels. A scene is illuminated with an unknown, unstructured source, and the measured response is the convolution of this source with multiple channel responses, each of which is…

Information Theory · Computer Science 2017-08-25 Kiryung Lee , Felix Krahmer , Justin Romberg

Processes with almost periodic covariance functions have spectral mass on lines parallel to the diagonal in the two-dimensional spectral plane. Methods have been given for estimation of spectral mass on the lines of spectral concentration…

Statistics Theory · Mathematics 2008-06-30 Keh-Shin Lii , Murray Rosenblatt

A common task is the determination of system parameters from spectroscopy, where one compares the experimental spectrum with calculated spectra, that depend on the desired parameters. Here we discuss an approach based on a machine learning…

Quantum Physics · Physics 2022-05-04 Farhad Taher-Ghahramani , Fulu Zheng , Alexander Eisfeld

Estimation of a vector from quantized linear measurements is a common problem for which simple linear techniques are suboptimal -- sometimes greatly so. This paper develops generalized approximate message passing (GAMP) algorithms for…

Information Theory · Computer Science 2015-03-24 Ulugbek Kamilov , Vivek K. Goyal , Sundeep Rangan

Spectral density matrix estimation of multivariate time series is a classical problem in time series and signal processing. In modern neuroscience, spectral density based metrics are commonly used for analyzing functional connectivity among…

Methodology · Statistics 2018-12-04 Yiming Sun , Yige Li , Amy Kuceyeski , Sumanta Basu

In this paper, we develop a novel framework to optimally design spectral estimators for phase retrieval given measurements realized from an arbitrary model. We begin by deconstructing spectral methods, and identify the fundamental…

Signal Processing · Electrical Eng. & Systems 2020-12-14 Bariscan Yonel , Birsen Yazici

We consider the problem of how many samples from a Gaussian multi-index model are required to weakly reconstruct the relevant index subspace. Despite its increasing popularity as a testbed for investigating the computational complexity of…

Machine Learning · Computer Science 2025-06-11 Leonardo Defilippis , Yatin Dandi , Pierre Mergny , Florent Krzakala , Bruno Loureiro

Higher-order spectra (or polyspectra), defined as the Fourier Transform of a stationary process' autocumulants, are useful in the analysis of nonlinear and non Gaussian processes. Polyspectral means are weighted averages over Fourier…

Statistics Theory · Mathematics 2024-10-23 Dhrubajyoti Ghosh , Tucker McElroy , Soumendra Lahiri

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

Machine Learning · Statistics 2025-03-25 Zehao Li , Yijie Peng

In this paper, we propose a perceptually-guided visualization sharpening technique. We analyze the spectral behavior of an established comprehensive perceptual model to arrive at our approximated model based on an adapted weighting of the…

Graphics · Computer Science 2019-07-25 Liang Zhou , Rudolf Netzel , Daniel Weiskopf , Chris Johnson

We derive, similar to Lau and Riha, a matrix formulation of a general best approximation theorem of Singer for the special case of spectral approximations of a given matrix from a given subspace. Using our matrix formulation we describe the…

Numerical Analysis · Mathematics 2025-06-12 Vance Faber , Jörg Liesen , Petr Tichý

We describe a novel algorithm for solving general parametric (nonlinear) eigenvalue problems. Our method has two steps: first, high-accuracy solutions of non-parametric versions of the problem are gathered at some values of the parameters;…

Numerical Analysis · Mathematics 2024-10-14 Davide Pradovera , Alessandro Borghi

Spectral methods have myriad applications in high-dimensional statistics and data science, and while previous works have primarily focused on $\ell_2$ or $\ell_{2,\infty}$ eigenvector and singular vector perturbation theory, in many…

Statistics Theory · Mathematics 2026-05-11 Joshua Agterberg

We develop an approach to spectral estimation that has been advocated by Ferrante, Masiero and Pavon and, in the context of the scalar-valued covariance extension problem, by Enqvist and Karlsson. The aim is to determine the power spectrum…

Systems and Control · Computer Science 2016-05-13 Tryphon T. Georgiou , Anders Lindquist

We study the problem of parameters estimation in Indirect Observability contexts, where $X_t \in R^r$ is an unobservable stationary process parametrized by a vector of unknown parameters and all observable data are generated by an…

Probability · Mathematics 2016-01-20 Robert Azencott , Peng Ren , Ilya Timofeyev

Debiasing is a fundamental concept in high-dimensional statistics. While degrees-of-freedom adjustment is the state-of-the-art technique in high-dimensional linear regression, it is limited to i.i.d. samples and sub-Gaussian covariates.…

Statistics Theory · Mathematics 2026-01-01 Yufan Li , Pragya Sur

High-dimensional matrix regression has been studied in various aspects, such as statistical properties, computational efficiency and application to specific instances including multivariate regression, system identification and matrix…

Statistics Theory · Mathematics 2024-03-06 Xin Li , Dongya Wu