English
Related papers

Related papers: Group Symmetry and Covariance Regularization

200 papers

Symmetry in mathematical programming may lead to a multiplicity of solutions. In nonconvex optimisation, it can negatively affect the performance of the branch-and-bound algorithm. Symmetry may induce large search trees with multiple…

Optimization and Control · Mathematics 2019-01-23 Georgia Kouyialis , Ruth Misener

Exploiting symmetry inherent in data can significantly improve the sample efficiency of a learning procedure and the generalization of learned models. When data clearly reveals underlying symmetry, leveraging this symmetry can naturally…

Machine Learning · Computer Science 2024-12-20 Gyeonghoon Ko , Hyunsu Kim , Juho Lee

As science and engineering have become increasingly data-driven, the role of optimization has expanded to touch almost every stage of the data analysis pipeline, from signal and data acquisition to modeling and prediction. The optimization…

Machine Learning · Computer Science 2022-07-12 Yuqian Zhang , Qing Qu , John Wright

A class of network models with symmetry group $G$ that evolve as a Lie-Poisson system is derived from the framework of geometric mechanics, which generalises the classical Heisenberg model studied in statistical mechanics. We considered two…

Mathematical Physics · Physics 2018-05-01 Alexis Arnaudon , So Takao

Group-based sparsity models are proven instrumental in linear regression problems for recovering signals from much fewer measurements than standard compressive sensing. The main promise of these models is the recovery of "interpretable"…

Machine Learning · Computer Science 2015-03-05 Luca Baldassarre , Nirav Bhan , Volkan Cevher , Anastasios Kyrillidis , Siddhartha Satpathi

Symmetry is an important feature of many constraint programs. We show that any problem symmetry acting on a set of symmetry breaking constraints can be used to break symmetry. Different symmetries pick out different solutions in each…

Artificial Intelligence · Computer Science 2010-05-31 George Katsirelos , Toby Walsh

We compute approximate solutions to inverse problems for determining parameters in differential equation models with stochastic data on output quantities. The formulation of the problem and modeling framework define a solution as a…

Numerical Analysis · Mathematics 2014-07-16 Troy Butler , Don Estep , Simon Tavener , Timothy Wildey , Clint Dawson , Lindley Graham

We study how the spin-statistics theorem relates to the geometric structures on phase space that are introduced in quantisation procedures (namely a U(1) bundle and connection). The relation can be proved in both the relativistic and the…

Quantum Physics · Physics 2016-09-08 Charis Anastopoulos

Stochastic symmetries and related invariance properties of finite dimensional SDEs driven by general c\`adl\`ag semimartingales taking values in Lie groups are defined and investigated. In order to enlarge the class of possible symmetries…

Probability · Mathematics 2017-08-08 Sergio Albeverio , Francesco C. De Vecchi , Paola Morando , Stefania Ugolini

Estimation of covariance matrices or their inverses plays a central role in many statistical methods. For these methods to work reliably, estimated matrices must not only be invertible but also well-conditioned. In this paper we present an…

Methodology · Statistics 2014-08-06 Eric C. Chi , Kenneth Lange

The relation between symmetry reduction before and after quantization of a field theory is discussed using a toy model: the axisymmetric Klein-Gordon field. We consider three possible notions of symmetry at the quantum level: invariance…

General Relativity and Quantum Cosmology · Physics 2009-11-11 Jonathan Engle

Relying on recent advances in statistical estimation of covariance distances based on random matrix theory, this article proposes an improved covariance and precision matrix estimation for a wide family of metrics. The method is shown to…

Machine Learning · Statistics 2021-02-03 Malik Tiomoko , Florent Bouchard , Guillaume Ginholac , Romain Couillet

Symmetry is ubiquitous in many real-world phenomena and tasks, such as physics, images, and molecular simulations. Empirical studies have demonstrated that incorporating symmetries into generative models can provide better generalization…

Machine Learning · Statistics 2026-05-12 Ziyu Chen , Markos A. Katsoulakis , Benjamin J. Zhang

We use Stein's method to obtain bounds on the rate of convergence for a class of statistics in geometric probability obtained as a sum of contributions from Poisson points which are exponentially stabilizing, i.e. locally determined in a…

Probability · Mathematics 2007-05-23 Mathew D. Penrose , J. E. Yukich

This paper discusses a general framework for smoothing parameter estimation for models with regular likelihoods constructed in terms of unknown smooth functions of covariates. Gaussian random effects and parametric terms may also be…

Methodology · Statistics 2016-05-10 Simon N. Wood , Natalya Pya , Benjamin Säfken

Finite Gaussian mixture models are widely used for model-based clustering of continuous data. Nevertheless, since the number of model parameters scales quadratically with the number of variables, these models can be easily…

Methodology · Statistics 2018-09-25 Michael Fop , Thomas Brendan Murphy , Luca Scrucca

Units equivariance (or units covariance) is the exact symmetry that follows from the requirement that relationships among measured quantities of physics relevance must obey self-consistent dimensional scalings. Here, we express this…

Machine Learning · Statistics 2023-06-26 Soledad Villar , Weichi Yao , David W. Hogg , Ben Blum-Smith , Bianca Dumitrascu

We outline a new, systematic way of constructing and analysing field theories, where all possible continuous symmetries of a given model are derived using the method of Lie point symmetries. If the model has free parameters, and…

High Energy Physics - Theory · Physics 2011-05-25 Damien P. George

Gauge invariance in discrete dynamical systems and its connection with quantization are considered. For a complete description of gauge symmetries of a system we construct explicitly a class of groups unifying in a natural way the space and…

Mathematical Physics · Physics 2015-05-13 Vladimir V. Kornyak

The dictionary learning problem concerns the task of representing data as sparse linear sums drawn from a smaller collection of basic building blocks. In application domains where such techniques are deployed, we frequently encounter…

Signal Processing · Electrical Eng. & Systems 2021-07-21 Yong Sheng Soh