English
Related papers

Related papers: Spectral Ergodicity in Deep Learning Architectures…

200 papers

The role of the normalized modularity matrix in finding homogeneous cuts will be presented. We also discuss the testability of the structural eigenvalues and that of the subspace spanned by the corresponding eigenvectors of this matrix. In…

Statistics Theory · Mathematics 2013-01-23 Marianna Bolla

Uncertainty estimation and ensembling methods go hand-in-hand. Uncertainty estimation is one of the main benchmarks for assessment of ensembling performance. At the same time, deep learning ensembles have provided state-of-the-art results…

Machine Learning · Statistics 2021-07-20 Arsenii Ashukha , Alexander Lyzhov , Dmitry Molchanov , Dmitry Vetrov

Previous literature on random matrix and network science has traditionally employed measures derived from nearest-neighbor level spacing distributions to characterize the eigenvalue statistics of random matrices. This approach, however,…

Disordered Systems and Neural Networks · Physics 2021-01-04 Thomas Peron , Bruno Messias F. de Resende , Francisco A. Rodrigues , Luciano da F. Costa , J. A. Méndez-Bermúdez

Euclidean random matrices arise in a wide range of physical systems where interactions are determined by spatial configurations, including disordered media and cooperative phenomena in atomic ensembles. Unlike classical random matrix…

Statistical Mechanics · Physics 2026-05-08 Pasquale Casaburi , Pierpaolo Vivo

We study the spectral properties of infinitely smooth multivariate kernel matrices when the nodes form a single cluster. We show that the geometry of the nodes plays an important role in the scaling of the eigenvalues of these kernel…

Numerical Analysis · Mathematics 2026-01-12 Nuha Diab , Dmitry Batenkov

Graph spectra have been successfully used to classify network types, compute the similarity between graphs, and determine the number of communities in a network. For large graphs, where an eigen-decomposition is infeasible, iterative moment…

Machine Learning · Statistics 2019-03-27 Diego Granziol , Binxin Ru , Stefan Zohren , Xiaowen Dong , Michael Osborne , Stephen Roberts

When a granular system is tapped, its volume changes. Here, using a well-defined macroscopic protocol, we prepare an ensemble of granular systems and track the statistics of volume changes as a function of the number of taps. This is in…

Statistical Mechanics · Physics 2015-06-11 Fabien Paillusson , Daan Frenkel

We study the spectrum of an asymmetric random matrix with block structured variances. The rows and columns of the random square matrix are divided into $D$ partitions with arbitrary size (linear in $N$). The parameters of the model are the…

Probability · Mathematics 2015-10-28 Johnatan Aljadeff , David Renfrew , Merav Stern

This paper introduces a novel framework that combines traditional centrality measures with eigenvalue spectra and diffusion processes for a more comprehensive analysis of complex networks. While centrality measures such as degree,…

Other Computer Science · Computer Science 2025-03-28 Arsh Jha

In physics, it is sometimes desirable to compute the so-called \emph{Density Of States} (DOS), also known as the \emph{spectral density}, of a real symmetric matrix $A$. The spectral density can be viewed as a probability density…

Numerical Analysis · Mathematics 2014-10-07 Lin Lin , Yousef Saad , Chao Yang

In recent years, hyperspectral imaging, also known as imaging spectroscopy, has been paid an increasing interest in geoscience and remote sensing community. Hyperspectral imagery is characterized by very rich spectral information, which…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Danfeng Hong , Jing Yao , Xin Wu , Jocelyn Chanussot , Xiao Xiang Zhu

In order to clarify the statistical features of complex networks, the spectral density of adjacency matrices has often been investigated. Adopting a static model introduced by Goh, Kahng and Kim, we analyse the spectral density of complex…

Statistical Mechanics · Physics 2009-11-13 Taro Nagao , G. J. Rodgers

A formalism for study of spectral correlations in non-Gaussian, unitary invariant ensembles of large random matrices with strong level confinement is reviewed. It is based on the Shohat method in the theory of orthogonal polynomials. The…

Statistical Mechanics · Physics 2016-08-31 E. Kanzieper , V. Freilikher

The expected Euler characteristic (EEC) method is an integral-geometric method used to approximate the tail probability of the maximum of a random field on a manifold. Noting that the largest eigenvalue of a real-symmetric or Hermitian…

Probability · Mathematics 2023-08-17 Satoshi Kuriki

Machine learning for scientific applications faces the challenge of limited data. We propose a framework that leverages a priori known physics to reduce overfitting when training on relatively small datasets. A deep neural network is…

Machine Learning · Computer Science 2019-11-22 Jonathan B. Freund , Jonathan F. MacArt , Justin Sirignano

Linear mixture models are commonly used to represent hyperspectral datacube as a linear combinations of endmember spectra. However, determining of the number of endmembers for images embedded in noise is a crucial task. This paper proposes…

Applications · Statistics 2016-06-29 A. Halimi , P. Honeine , M. Kharouf , C. Richard , J. -Y. Tourneret

We derive the spectral properties of adjacency matrix of complex networks and of their Laplacian by the replica method combined with a dynamical population algorithm. By assuming the order parameter to be a product of Gaussian…

Disordered Systems and Neural Networks · Physics 2008-04-11 Ginestra Bianconi

In this work, we present some applications of random matrix theory for the training of deep neural networks. Recently, random matrix theory (RMT) has been applied to the overfitting problem in deep learning. Specifically, it has been shown…

Machine Learning · Computer Science 2023-03-17 Yitzchak Shmalo , Jonathan Jenkins , Oleksii Krupchytskyi

The extreme eigenvalues of adjacency matrices are important indicators on the influences of topological structures to collective dynamical behavior of complex networks. Recent findings on the ensemble averageability of the extreme…

Physics and Society · Physics 2015-05-28 Ning Ning Chung , Lock Yue Chew , Choy Heng Lai

Deep learning models have seen significant successes in numerous applications, but their inner workings remain elusive. The purpose of this work is to quantify the learning process of deep neural networks through the lens of a novel…

Machine Learning · Computer Science 2023-05-10 Rayna Andreeva , Katharina Limbeck , Bastian Rieck , Rik Sarkar
‹ Prev 1 4 5 6 7 8 10 Next ›