English
Related papers

Related papers: Spectral Methods for Data Science: A Statistical P…

200 papers

Spectral clustering is a popular method for effectively clustering nonlinearly separable data. However, computational limitations, memory requirements, and the inability to perform incremental learning challenge its widespread application.…

Machine Learning · Computer Science 2023-11-15 Jo-Chun Chen , Hung-Hsuan Chen

Permutation synchronization is an important problem in computer science that constitutes the key step of many computer vision tasks. The goal is to recover $n$ latent permutations from their noisy and incomplete pairwise measurements. In…

Statistics Theory · Mathematics 2024-05-13 Duc Nguyen , Anderson Ye Zhang

Computing eigenvalues of very large matrices is a critical task in many machine learning applications, including the evaluation of log-determinants, the trace of matrix functions, and other important metrics. As datasets continue to grow in…

Machine Learning · Statistics 2025-06-16 Siavash Ameli , Chris van der Heide , Liam Hodgkinson , Michael W. Mahoney

Mass spectrometry is a widely used method to study molecules and processes in medicine, life sciences, chemistry, catalysis, and industrial product quality control, among many other applications. One of the main features of some mass…

Chemical Physics · Physics 2024-07-02 Daniil A. Boiko , Valentine P. Ananikov

Anomaly detection in massive networks has numerous theoretical and computational challenges, especially as the behavior to be detected becomes small in comparison to the larger network. This presentation focuses on recent results in three…

Social and Information Networks · Computer Science 2014-12-16 Benjamin A. Miller , Nicholas Arcolano , Michael M. Wolf , Nadya T. Bliss

Many estimation problems in astrophysics are highly complex, with high-dimensional, non-standard data objects (e.g., images, spectra, entire distributions, etc.) that are not amenable to formal statistical analysis. To utilize such data and…

Applications · Statistics 2011-11-04 Ann B. Lee , Peter E. Freeman

Spectral methods which represent data points by eigenvectors of kernel matrices or graph Laplacian matrices have been a primary tool in unsupervised data analysis. In many application scenarios, parametrizing the spectral embedding by a…

Machine Learning · Statistics 2022-06-15 Ziyu Chen , Yingzhou Li , Xiuyuan Cheng

Some spectral data analysis methods that are useful for the two-dimensional imaging diagnostics data are introduced. It is shown that the frequency spectrum, the local dispersion relation, the flow shear, and the nonlinear energy transfer…

Data Analysis, Statistics and Probability · Physics 2019-08-28 Minjun J. Choi

We focus on an alignment-free method to estimate the underlying signal from a large number of noisy randomly shifted observations. Specifically, we estimate the mean, power spectrum, and bispectrum of the signal from the observations. Since…

Signal Processing · Electrical Eng. & Systems 2018-07-04 Hua Chen , Mona Zehni , Zhizhen Zhao

Spectral clustering refers to a family of unsupervised learning algorithms that compute a spectral embedding of the original data based on the eigenvectors of a similarity graph. This non-linear transformation of the data is both the key of…

Machine Learning · Computer Science 2019-01-30 Nicolas Tremblay , Andreas Loukas

We consider the problem of parameter estimation in a high-dimensional generalized linear model. Spectral methods obtained via the principal eigenvector of a suitable data-dependent matrix provide a simple yet surprisingly effective…

Statistics Theory · Mathematics 2025-07-11 Yihan Zhang , Hong Chang Ji , Ramji Venkataramanan , Marco Mondelli

Spectral algorithms are graph partitioning algorithms that partition a node set of a graph into groups by using a spectral embedding map. Clustering techniques based on the algorithms are referred to as spectral clustering and are widely…

Machine Learning · Computer Science 2021-09-08 Tomohiko Mizutani

Classification is valuable and necessary in spectral analysis, especially for data-driven mining. Along with the rapid development of spectral surveys, a variety of classification techniques have been successfully applied to astronomical…

Instrumentation and Methods for Astrophysics · Physics 2022-12-20 Haifeng Yang , Lichan Zhou , Jianghui Cai , Chenhui Shi , Yuqing Yang , Xujun Zhao , Juncheng Duan , Xiaona Yin

X-ray spectroscopy is a powerful technique for the analysis of the energy distribution of X-rays from astrophysical sources. It allows for the study of the properties, composition, and physical processes taking place at the site of…

High Energy Astrophysical Phenomena · Physics 2023-09-22 L. Ducci , C. Malacaria

Although there is an extensive literature on the eigenvalues of high-dimensional sample covariance matrices, much of it is specialized to independent components (IC) models -- in which observations are represented as linear transformations…

Statistics Theory · Mathematics 2023-05-05 Siyao Wang , Miles E. Lopes

Results on the spectral behavior of random matrices as the dimension increases are applied to the problem of detecting the number of sources impinging on an array of sensors. A common strategy to solve this problem is to estimate the…

Statistics Theory · Mathematics 2022-12-09 J. W. Silverstein , P. L. Combettes

Neural integral equations are deep learning models based on the theory of integral equations, where the model consists of an integral operator and the corresponding equation (of the second kind) which is learned through an optimization…

Numerical Analysis · Mathematics 2025-11-14 Emanuele Zappala

We present Neural Spectral Methods, a technique to solve parametric Partial Differential Equations (PDEs), grounded in classical spectral methods. Our method uses orthogonal bases to learn PDE solutions as mappings between spectral…

Machine Learning · Computer Science 2024-01-22 Yiheng Du , Nithin Chalapathi , Aditi Krishnapriyan

Spectral clustering is a leading and popular technique in unsupervised data analysis. Two of its major limitations are scalability and generalization of the spectral embedding (i.e., out-of-sample-extension). In this paper we introduce a…

Machine Learning · Statistics 2024-11-06 Uri Shaham , Kelly Stanton , Henry Li , Boaz Nadler , Ronen Basri , Yuval Kluger

Speckle patterns are used in a broad range of applications including microscopy, imaging, and light-matter interactions. Tailoring speckles' statistics can dramatically enhance their performance in applications. We present an experimental…