English
Related papers

Related papers: Dimension-free Concentration Bounds on Hankel Matr…

200 papers

The signal resulting from magnetic resonance spectroscopy is occupied by noises and irregularities so in the further analysis preprocessing techniques have to be introduced. The main idea of the paper is to develop a model of a signal as a…

Signal Processing · Electrical Eng. & Systems 2021-03-30 Michał Staniszewski , Andrzej Polański

This work is concerned with the limiting spectral distribution of rank-based dependency measures in high dimensions. We provide distribution-free results for multivariate empirical versions of Kendall's $\tau$ and Spearman's $\rho$ in a…

Statistics Theory · Mathematics 2025-08-22 Nina Dörnemann , Michael Fleermann , Johannes Heiny

Spectral estimators are fundamental in lowrank matrix models and arise throughout machine learning and statistics, with applications including network analysis, matrix completion and PCA. These estimators aim to recover the leading…

Statistics Theory · Mathematics 2025-02-17 Hao Yan , Keith Levin

In recent years, the spectral analysis of appropriately defined kernel matrices has emerged as a principled way to extract the low-dimensional structure often prevalent in high-dimensional data. Here we provide an introduction to spectral…

Machine Learning · Statistics 2010-04-20 Mohamed-Ali Belabbas , Patrick J. Wolfe

We study machine learning of phenomenologically relevant properties of string compactifications, which arise in the context of heterotic line bundle models. Both supervised and unsupervised learning are considered. We find that, for a fixed…

High Energy Physics - Theory · Physics 2020-03-31 Rehan Deen , Yang-Hui He , Seung-Joo Lee , Andre Lukas

Spectral algorithms leverage spectral regularization techniques to analyze and process data, providing a flexible framework for addressing supervised learning problems. To deepen our understanding of their performance in real-world…

Machine Learning · Statistics 2025-07-23 Jun Fan , Zheng-Chu Guo , Lei Shi

Non-parametric representations of dynamical systems based on the image of a Hankel matrix of data are extensively used for data-driven control. However, if samples of data are missing, obtaining such representations becomes a difficult…

Systems and Control · Electrical Eng. & Systems 2024-07-09 Mohammad Alsalti , Ivan Markovsky , Victor G. Lopez , Matthias A. Müller

We consider learning parameters of Binomial Hidden Markov Models, which may be used to model DNA methylation data. The standard algorithm for the problem is EM, which is computationally expensive for sequences of the scale of the mammalian…

Machine Learning · Computer Science 2018-02-08 Chicheng Zhang , Eran A. Mukamel , Kamalika Chaudhuri

Random feature maps are ubiquitous in modern statistical machine learning, where they generalize random projections by means of powerful, yet often difficult to analyze nonlinear operators. In this paper, we leverage the "concentration"…

Machine Learning · Statistics 2021-03-18 Zhenyu Liao , Romain Couillet

In this paper, our objective is to present a constraining principle governing the spectral properties of the sample covariance matrix. This principle exhibits harmonious behavior across diverse limiting frameworks, eliminating the need for…

Statistics Theory · Mathematics 2024-01-03 Yanqing Yin

The topic of this paper is the typical behavior of the spectral measures of large random matrices drawn from several ensembles of interest, including in particular matrices drawn from Haar measure on the classical Lie groups, random…

Probability · Mathematics 2013-09-16 Elizabeth S. Meckes , Mark W. Meckes

The Hilbert Schmidt Independence Criterion (HSIC) is a kernel dependence measure that has applications in various aspects of machine learning. Conveniently, the objectives of different dimensionality reduction applications using HSIC often…

Machine Learning · Statistics 2019-09-12 Chieh Wu , Jared Miller , Yale Chang , Mario Sznaier , Jennifer Dy

We derive analytical expressions for the generalization performance of kernel regression as a function of the number of training samples using theoretical methods from Gaussian processes and statistical physics. Our expressions apply to…

Machine Learning · Computer Science 2021-02-26 Blake Bordelon , Abdulkadir Canatar , Cengiz Pehlevan

The spectral dimension has been widely used to understand transport properties on regular and fractal lattices. Nevertheless, it has been little studied for complex networks such as scale-free and small world networks. Here we study the…

Statistical Mechanics · Physics 2015-05-19 S. Hwang , C. -K Yun , D. -S. Lee , B. Kahng , D. Kim

For a large class of symmetric random matrices with correlated entries, selected from stationary random fields of centered and square integrable variables, we show that the limiting distribution of eigenvalue counting measure always exists…

Probability · Mathematics 2016-03-08 Costel Peligrad , Magda Peligrad

To improve the classification performance in the context of hyperspectral image processing, many works have been developed based on two common strategies, namely the spatial-spectral information integration and the utilization of neural…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Yi Liang , Xin Zhao , Alan J. X. Guo , Fei Zhu

Interpretable classification of time series presents significant challenges in high dimensions. Traditional feature selection methods in the frequency domain often assume sparsity in spectral density matrices (SDMs) or their inverses, which…

Machine Learning · Statistics 2024-08-19 Sarbojit Roy , Malik Shahid Sultan , Hernando Ombao

This paper investigates the convergence properties of spectral algorithms -- a class of regularization methods originating from inverse problems -- under covariate shift. In this setting, the marginal distributions of inputs differ between…

Machine Learning · Statistics 2025-09-08 Ren-Rui Liu , Zheng-Chu Guo

We are interested in assessing the order of a finite-state Hidden Markov Model (HMM) with the only two assumptions that the transition matrix of the latent Markov chain has full rank and that the density functions of the emission…

Statistics Theory · Mathematics 2023-11-29 Marie Du Roy de Chaumaray , Salima El Kolei , Marie-Pierre Etienne , Matthieu Marbac

We provide guarantees for learning latent variable models emphasizing on the overcomplete regime, where the dimensionality of the latent space can exceed the observed dimensionality. In particular, we consider multiview mixtures, spherical…

Machine Learning · Computer Science 2014-12-18 Animashree Anandkumar , Rong Ge , Majid Janzamin