English
Related papers

Related papers: Learning Lie Group Symmetry Transformations with N…

200 papers

It is common in machine learning and statistics to use symmetries derived from expert knowledge to simplify problems or improve performance, using methods like data augmentation or penalties. In this paper we consider the unsupervised and…

Machine Learning · Computer Science 2022-04-05 Colin Hagemeyer

The detection of change-points in a spatially or time ordered data sequence is an important problem in many fields such as genetics and finance. We derive the asymptotic distribution of a statistic recently suggested for detecting…

Statistics Theory · Mathematics 2015-10-01 Gérard Biau , Kevin Bleakley , David Mason

Link prediction is a crucial problem in graph-structured data. Due to the recent success of graph neural networks (GNNs), a variety of GNN-based models were proposed to tackle the link prediction task. Specifically, GNNs leverage the…

Machine Learning · Computer Science 2022-12-06 Kaiwen Dong , Yijun Tian , Zhichun Guo , Yang Yang , Nitesh V. Chawla

We explore the role of group symmetries in binary classification tasks, presenting a novel framework that leverages the principles of Neyman-Pearson optimality. Contrary to the common intuition that larger symmetry groups lead to improved…

Machine Learning · Computer Science 2024-08-19 Vishal S. Ngairangbam , Michael Spannowsky

Data analysis and data mining are concerned with unsupervised pattern finding and structure determination in data sets. The data sets themselves are explicitly linked as a form of representation to an observational or otherwise empirical…

Machine Learning · Statistics 2011-01-11 Fionn Murtagh

Neural compression is the application of neural networks and other machine learning methods to data compression. Recent advances in statistical machine learning have opened up new possibilities for data compression, allowing compression…

Machine Learning · Computer Science 2023-08-22 Yibo Yang , Stephan Mandt , Lucas Theis

Symmetry is a powerful tool for finding analytical solutions to differential equations, both partial and ordinary, via the similarity variables or via the invariance of the equation under group transformations. It is the largest group of…

Dynamical Systems · Mathematics 2024-10-01 Mensah Folly-Gbetoula , Kwassi Anani

Geometric graphs are a special kind of graph with geometric features, which are vital to model many scientific problems. Unlike generic graphs, geometric graphs often exhibit physical symmetries of translations, rotations, and reflections,…

Machine learning algorithms are optimized to model statistical properties of the training data. If the input data reflects stereotypes and biases of the broader society, then the output of the learning algorithm also captures these…

Computation and Language · Computer Science 2016-06-21 Tolga Bolukbasi , Kai-Wei Chang , James Zou , Venkatesh Saligrama , Adam Kalai

A method is presented for calculating the Lie point symmetries of a scalar difference equation on a two-dimensional lattice. The symmetry transformations act on the equations and on the lattice. They take solutions into solutions and can be…

Mathematical Physics · Physics 2013-07-10 Decio Levi , Sébastien Tremblay , Pavel Winternitz

Recent work has used deep learning to derive symmetry transformations, which preserve conserved quantities, and to obtain the corresponding algebras of generators. In this letter, we extend this technique to derive sparse representations of…

High Energy Physics - Phenomenology · Physics 2023-08-09 Roy T. Forestano , Konstantin T. Matchev , Katia Matcheva , Alexander Roman , Eyup B. Unlu , Sarunas Verner

Capturing symmetric (e.g., country borders another country) and antisymmetric (e.g., parent_of) relations is crucial for a variety of applications. This paper tackles this challenge by introducing a novel Wikidata-derived natural language…

Computation and Language · Computer Science 2025-04-24 Zhangdie Yuan , Andreas Vlachos

Shape analysis methods have in the past few years become very popular, both for theoretical exploration as well as from an application point of view. Originally developed for planar curves, these methods have been expanded to higher…

Differential Geometry · Mathematics 2016-09-27 Elena Celledoni , Markus Eslitzbichler , Alexander Schmeding

Machine learning models are routinely integrated into process mining pipelines to carry out tasks like data transformation, noise reduction, anomaly detection, classification, and prediction. Often, the design of such models is based on…

Machine Learning · Computer Science 2024-02-21 Paolo Ceravolo , Sylvio Barbon Junior , Ernesto Damiani , Wil van der Aalst

In machine learning, a bias occurs whenever training sets are not representative for the test data, which results in unreliable models. The most common biases in data are arguably class imbalance and covariate shift. In this work, we aim to…

Machine Learning · Computer Science 2018-04-04 Patrick Glauner , Radu State , Petko Valtchev , Diogo Duarte

Symmetry is one of the most central concepts in physics, and it is no surprise that it has also been widely adopted as an inductive bias for machine-learning models applied to the physical sciences. This is especially true for models…

Chemical Physics · Physics 2024-12-23 Marcel F. Langer , Sergey N. Pozdnyakov , Michele Ceriotti

Deep neural networks need a big amount of training data, while in the real world there is a scarcity of data available for training purposes. To resolve this issue unsupervised methods are used for training with limited data. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Sayed Hashim , Muhammad Ali

Class imbalance poses a challenge for developing unbiased, accurate predictive models. In particular, in image segmentation neural networks may overfit to the foreground samples from small structures, which are often heavily…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Zeju Li , Konstantinos Kamnitsas , Ben Glocker

The dictionary learning problem can be viewed as a data-driven process to learn a suitable transformation so that data is sparsely represented directly from example data. In this paper, we examine the problem of learning a dictionary that…

Optimization and Control · Mathematics 2026-02-05 Subhroshekhar Ghosh , Aaron Y. R. Low , Yong Sheng Soh , Zhuohang Feng , Brendan K. Y. Tan

Neural networks appear to have mysterious generalization properties when using parameter counting as a proxy for complexity. Indeed, neural networks often have many more parameters than there are data points, yet still provide good…

Machine Learning · Computer Science 2020-05-26 Wesley J. Maddox , Gregory Benton , Andrew Gordon Wilson