English
Related papers

Related papers: Learning Lie Group Symmetry Transformations with N…

200 papers

Neural networks that process the parameters of other neural networks find applications in domains as diverse as classifying implicit neural representations, generating neural network weights, and predicting generalization errors. However,…

Recognizing precise geometrical configurations of groups of objects is a key capability of human spatial cognition, yet little studied in the deep learning literature so far. In particular, a fundamental problem is how a machine can learn…

Machine Learning · Computer Science 2020-07-20 Laetitia Teodorescu , Katja Hofmann , Pierre-Yves Oudeyer

Learning-based planners leveraging Graph Neural Networks can learn search guidance applicable to large search spaces, yet their potential to address symmetries remains largely unexplored. In this paper, we introduce a graph representation…

Artificial Intelligence · Computer Science 2025-04-29 Yingbin Bai , Sylvie Thiebaux , Felipe Trevizan

In this thesis, we study the one parameter point transformations which leave invariant the differential equations. In particular we study the Lie and the Noether point symmetries of second order differential equations. We establish a new…

General Relativity and Quantum Cosmology · Physics 2015-01-22 Andronikos Paliathanasis

The solution of problems in physics is often facilitated by a change of variables. In this work we present neural transformations to learn symmetries of Hamiltonian mechanical systems. Maintaining the Hamiltonian structure requires novel…

Computational Physics · Physics 2019-06-12 Roberto Bondesan , Austen Lamacraft

Deep neural networks have excelled on a wide range of problems, from vision to language and game playing. Neural networks very gradually incorporate information into weights as they process data, requiring very low learning rates. If the…

Conventional machine learning algorithms have traditionally been designed under the assumption that input data follows a vector-based format, with an emphasis on vector-centric paradigms. However, as the demand for tasks involving set-based…

Machine Learning · Computer Science 2024-04-01 Masanari Kimura , Ryotaro Shimizu , Yuki Hirakawa , Ryosuke Goto , Yuki Saito

Lie group theory was originally created more than 100 years ago as a tool for solving ordinary and partial differential equations. In this article we review the results of a much more recent program: the use of Lie groups to study…

Exactly Solvable and Integrable Systems · Physics 2009-11-11 D. Levi , P. Winternitz

This paper presents a series of general results about the optimal estimation of physical transformations in a given symmetry group. In particular, it is shown how the different symmetries of the problem determine different properties of the…

Quantum Physics · Physics 2015-03-17 G. Chiribella

Supervised deep learning models require significant amount of labeled data to achieve an acceptable performance on a specific task. However, when tested on unseen data, the models may not perform well. Therefore, the models need to be…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Akshit Achara , Ram Krishna Pandey

Symmetry learning has proven to be an effective approach for extracting the hidden structure of data, with the concept of equivariance relation playing the central role. However, most of the current studies are built on architectural theory…

Machine Learning · Statistics 2024-02-15 Masanori Koyama , Kenji Fukumizu , Kohei Hayashi , Takeru Miyato

In this work, we formally prove that, under certain conditions, if a neural network is invariant to a finite group then its weights recover the Fourier transform on that group. This provides a mathematical explanation for the emergence of…

Machine Learning · Computer Science 2024-06-17 Giovanni Luca Marchetti , Christopher Hillar , Danica Kragic , Sophia Sanborn

Biological intelligence is remarkable in its ability to produce complex behaviour in many diverse situations through data efficient, generalisable and transferable skill acquisition. It is believed that learning "good" sensory…

Neurons and Cognition · Quantitative Biology 2022-03-18 Irina Higgins , Sébastien Racanière , Danilo Rezende

Left-invariant optimal control problems on Lie groups form an important class of problems with big symmetry group. They are interesting from the theoretical point of view since they often can be completely studied, and general features can…

Optimization and Control · Mathematics 2021-05-18 Yuri Sachkov

Interactions among people or objects are often dynamic in nature and can be represented as a sequence of networks, each providing a snapshot of the interactions over a brief period of time. An important task in analyzing such evolving…

Social and Information Networks · Computer Science 2016-06-17 Leto Peel , Aaron Clauset

A change points detection aims to catch an abrupt disorder in data distribution. Common approaches assume that there are only two fixed distributions for data: one before and another after a change point. Real-world data are richer than…

Machine Learning · Computer Science 2022-04-18 Alexander Stepikin , Evgenia Romanenkova , Alexey Zaytsev

We propose Lie group embedded dynamical neural networks (LieEDNN) and the corresponding learning algorithms based on gradient descent and metric projection on smooth manifold, where we treat Lie group as an intrinsic representation for…

Machine Learning · Computer Science 2026-05-27 Tianwei Wang , Bryan Chen , Qian Zuo , Qiyue Xia , Xin Li , Wei Pang

Linked Datasets (LDs) are constantly evolving and the applications using a Linked Dataset (LD) may face several issues such as outdated data or broken interlinks due to evolution of the dataset. To overcome these issues, the detection of…

Databases · Computer Science 2019-05-21 Anuj Singh

In this paper we propose a framework to leverage Lie group symmetries on arbitrary spaces exploiting \textit{algebraic signal processing} (ASP). We show that traditional group convolutions are one particular instantiation of a more general…

Signal Processing · Electrical Eng. & Systems 2024-01-30 Harshat Kumar , Alejandro Parada-Mayorga , Alejandro Ribeiro

Machine learned models exhibit bias, often because the datasets used to train them are biased. This presents a serious problem for the deployment of such technology, as the resulting models might perform poorly on populations that are…

Machine Learning · Computer Science 2018-10-02 Daniel McDuff , Roger Cheng , Ashish Kapoor