English
Related papers

Related papers: Hessian Eigenspectra of More Realistic Nonlinear M…

200 papers

We propose a method to detect model misspecifications in nonlinear causal additive and potentially heteroscedastic noise models. We aim to identify predictor variables for which we can infer the causal effect even in cases of such…

Methodology · Statistics 2024-03-28 Christoph Schultheiss , Peter Bühlmann

We consider non-Hermitian random matrices $X \in \mathbb{C}^{n \times n}$ with general decaying correlations between their entries. For large $n$, the empirical spectral distribution is well approximated by a deterministic density,…

Probability · Mathematics 2021-02-25 Johannes Alt , Torben Krüger

We provide a first systematic treatment of so-called rectangular multispectral perturbation theory. With their paper from 2003, Hochstenbach and Plestenjak ["Backward Error, Condition Numbers, and Pseudospectra for the Multiparameter…

Numerical Analysis · Mathematics 2026-05-21 Christof Vermeersch , Sarthak De , Bart De Moor

We derive the exact form of the eigenvalue spectra of correlation matrices derived from a set of time-shifted, finite Brownian random walks (time-series). These matrices can be seen as random, real, asymmetric matrices with a special…

Physics and Society · Physics 2008-12-02 Christoly Biely , Stefan Thurner

Spectral unmixing is a crucial processing step when analyzing hyperspectral data. In such analysis, most of the work in the literature relies on the widely acknowledged linear mixing model to describe the observed pixels. Unfortunately,…

Data Analysis, Statistics and Probability · Physics 2014-04-21 Nicolas Dobigeon , Laurent Tits , Ben Somers , Yoann Altmann , Pol Coppin

Pseudospectral analysis serves as a powerful tool in matrix computation and the study of both linear and nonlinear dynamical systems. Among various numerical strategies, random sampling, especially in the form of rank-$1$ perturbations,…

Spectral Theory · Mathematics 2025-05-19 Kuo Gai , Bin Shi

We consider the problem of high-dimensional non-linear variable selection for supervised learning. Our approach is based on performing linear selection among exponentially many appropriately defined positive definite kernels that…

Machine Learning · Computer Science 2009-09-08 Francis Bach

Spike-and-slab and horseshoe regression are arguably the most popular Bayesian variable selection approaches for linear regression models. However, their performance can deteriorate if outliers and heteroskedasticity are present in the…

Methodology · Statistics 2022-10-20 Alberto Cabezas , Marco Battiston , Christopher Nemeth

The extraction of nonstationary signals from blind and semi-blind multivariate observations is a recurrent problem. Numerous algorithms have been developed for this problem, which are based on the exact or approximate joint diagonalization…

Signal Processing · Electrical Eng. & Systems 2021-08-27 Reza Sameni , Christian Jutten

Parameter inference is a fundamental problem in data-driven modeling. Given observed data that is believed to be a realization of some parameterized model, the aim is to find parameter values that are able to explain the observed data. In…

Data Structures and Algorithms · Computer Science 2016-04-20 Carlo Albert , Simone Ulzega , Ruedi Stoop

The random matrix theory method of planar Gaussian diagrammatic expansion is applied to find the mean spectral density of the Hermitian equal-time and non-Hermitian time-lagged cross-covariance estimators, firstly in the form of master…

Statistical Finance · Quantitative Finance 2012-05-22 Andrzej Jarosz

Computing eigenvalues of very large matrices is a critical task in many machine learning applications, including the evaluation of log-determinants, the trace of matrix functions, and other important metrics. As datasets continue to grow in…

Machine Learning · Statistics 2025-06-16 Siavash Ameli , Chris van der Heide , Liam Hodgkinson , Michael W. Mahoney

Non-asymptotic theory of random matrices strives to investigate the spectral properties of random matrices, which are valid with high probability for matrices of a large fixed size. Results obtained in this framework find their applications…

Probability · Mathematics 2013-08-02 Mark Rudelson

Spectral methods have myriad applications in high-dimensional statistics and data science, and while previous works have primarily focused on $\ell_2$ or $\ell_{2,\infty}$ eigenvector and singular vector perturbation theory, in many…

Statistics Theory · Mathematics 2026-05-11 Joshua Agterberg

Based on a Gaussian mixture type model , we derive an eigen selection procedure that improves the usual spectral clustering in high-dimensional settings. Concretely, we derive the asymptotic expansion of the spiked eigenvalues under…

Statistics Theory · Mathematics 2020-06-09 Xiao Han , Xin Tong , Yingying Fan

Models of disorder with a direction (constant imaginary vector-potential) are considered. These non-Hermitian models can appear as a result of computation for models of statistical physics using transfer matrix technique or describe…

Disordered Systems and Neural Networks · Physics 2009-10-30 K. B. Efetov

BART (Bayesian Additive Regression Trees) has become increasingly popular as a flexible and scalable nonparametric regression approach for modern applied statistics problems. For the practitioner dealing with large and complex nonlinear…

Methodology · Statistics 2018-07-11 Matthew Pratola , Hugh Chipman , Edward George , Robert McCulloch

Following our recent letter, we study in detail an entry-wise diffusion of non-hermitian complex matrices. We obtain an exact partial differential equation (valid for any matrix size $N$ and arbitrary initial conditions) for evolution of…

Mathematical Physics · Physics 2015-10-20 Zdzislaw Burda , Jacek Grela , Maciej A. Nowak , Wojciech Tarnowski , Piotr Warchoł

Despite the widespread utilization of Gaussian process models for versatile nonparametric modeling, they exhibit limitations in effectively capturing abrupt changes in function smoothness and accommodating relationships with heteroscedastic…

Machine Learning · Statistics 2023-09-01 Taehee Lee , Jun S. Liu

A general theory for Gaussian mean estimation that automatically adapts to unknown sparsity under arbitrary norms is proposed. The theory is applied to produce adaptively minimax rate-optimal estimators in high dimensional regression and…

Statistics Theory · Mathematics 2015-12-01 Sourav Chatterjee