English
Related papers

Related papers: Group Symmetry and Covariance Regularization

200 papers

We use random matrix theory to study the spectrum of random geometric graphs, a fundamental model of spatial networks. Considering ensembles of random geometric graphs we look at short range correlations in the level spacings of the…

Physics and Society · Physics 2017-06-08 Carl P. Dettmann , Orestis Georgiou , Georgie Knight

This work is about understanding the impact of invariance and equivariance on generalisation in supervised learning. We use the perspective afforded by an averaging operator to show that for any predictor that is not equivariant, there is…

Machine Learning · Computer Science 2025-01-08 Hayder Elesedy

We study how sampling geometry contributes to uncertainty in modeling spatial geophysical observations as sampled random fields characterized by stationary, isotropic, parametric covariance functions. We incorporate the signature of…

Methodology · Statistics 2026-04-03 Olivia L. Walbert , Frederik J. Simons , Arthur P. Guillaumin , Sofia C. Olhede

This paper discusses the interplay of symmetries and stability in the analysis and control of nonlinear dynamical systems and networks. Specifically, it combines standard results on symmetries and equivariance with recent convergence…

Dynamical Systems · Mathematics 2015-05-20 Giovanni Russo , Jean-Jacques E. Slotine

Designing a covariance function that represents the underlying correlation is a crucial step in modeling complex natural systems, such as climate models. Geospatial datasets at a global scale usually suffer from non-stationarity and…

Machine Learning · Statistics 2015-07-10 Chintan A. Dalal , Vladimir Pavlovic , Robert E. Kopp

Finding an unconstrained and statistically interpretable reparameterization of a covariance matrix is still an open problem in statistics. Its solution is of central importance in covariance estimation, particularly in the recent…

Methodology · Statistics 2012-02-09 Mohsen Pourahmadi

Recent work has shown deep learning can accelerate the prediction of physical dynamics relative to numerical solvers. However, limited physical accuracy and an inability to generalize under distributional shift limit its applicability to…

Machine Learning · Computer Science 2021-03-17 Rui Wang , Robin Walters , Rose Yu

We review various combinatorial applications of field theoretical and matrix model approaches to equilibrium statistical physics involving the enumeration of fixed and random lattice model configurations. We show how the structures of the…

Statistical Mechanics · Physics 2007-05-23 P. Di Francesco

Many supervised learning problems involve high-dimensional data such as images, text, or graphs. In order to make efficient use of data, it is often useful to leverage certain geometric priors in the problem at hand, such as invariance to…

Machine Learning · Statistics 2021-11-08 Alberto Bietti , Luca Venturi , Joan Bruna

Many machine learning tasks in the natural sciences are precisely equivariant to particular symmetries. Nonetheless, equivariant methods are often not employed, perhaps because training is perceived to be challenging, or the symmetry is…

Machine Learning · Computer Science 2025-11-27 Valentino F. Foit , David W. Hogg , Soledad Villar

Group theory is extremely successful in characterizing the symmetries in quantum systems, which greatly simplifies and unifies our treatments of quantum systems. Here we introduce the concept of the symmetry for a quantum Boltzmann machine…

Quantum Physics · Physics 2021-04-07 Hai-jing Song , D. L. Zhou

Symmetry principles underlie and guide scientific theory and research, from Curie's invariance formulation to modern applications across physics, chemistry, and mathematics. Building on a recent matrix Lie group measurement model, this…

Methodology · Statistics 2025-12-19 William R. Nugent

Multivariate spatial-statistical models are often used when modeling environmental and socio-demographic processes. The most commonly used models for multivariate spatial covariances assume both stationarity and symmetry for the…

Methodology · Statistics 2021-05-11 Quan Vu , Andrew Zammit-Mangion , Noel Cressie

In this thesis, a Bayes linear methodology for the adjustment of covariance matrices is presented and discussed. A geometric framework for quantifying uncertainties about covariance matrices is set up, and an inner-product for spaces of…

bayes-an · Physics 2016-08-31 Darren J Wilkinson

We consider the problem of estimating high-dimensional covariance matrices of $K$-populations or classes in the setting where the sample sizes are comparable to the data dimension. We propose estimating each class covariance matrix as a…

Methodology · Statistics 2022-02-08 Elias Raninen , David E. Tyler , Esa Ollila

Sparse models for high-dimensional linear regression and machine learning have received substantial attention over the past two decades. Model selection, or determining which features or covariates are the best explanatory variables, is…

Machine Learning · Statistics 2019-10-15 Yuan Li , Benjamin Mark , Garvesh Raskutti , Rebecca Willett , Hyebin Song , David Neiman

Symmetry arises often when learning from high dimensional data. For example, data sets consisting of point clouds, graphs, and unordered sets appear routinely in contemporary applications, and exhibit rich underlying symmetries.…

Optimization and Control · Mathematics 2025-02-06 Mateo Díaz , Dmitriy Drusvyatskiy , Jack Kendrick , Rekha R. Thomas

Recently, sparsity-based algorithms are proposed for super-resolution spectrum estimation. However, to achieve adequately high resolution in real-world signal analysis, the dictionary atoms have to be close to each other in frequency,…

Machine Learning · Statistics 2015-06-05 Yiyuan She , Huanghuang Li , Jiangping Wang , Dapeng Wu

Symmetry -- invariance to certain operators -- is a fundamental concept in many branches of physics. We propose ways to measure symmetric properties of vertices, and their surroundings, in networks. To be stable to the randomness inherent…

Disordered Systems and Neural Networks · Physics 2008-06-29 Petter Holme

In this review we establish various connections between complex networks and symmetry. While special types of symmetries (e.g., automorphisms) are studied in detail within discrete mathematics for particular classes of deterministic graphs,…

General Finance · Quantitative Finance 2010-11-04 Diego Garlaschelli , Franco Ruzzenenti , Riccardo Basosi