English
Related papers

Related papers: Incorporating Symmetry into Deep Dynamics Models f…

200 papers

Recently, equivariant neural networks for policy learning have shown promising improvements in sample efficiency and generalization, however, their wide adoption faces substantial barriers due to implementation complexity. Equivariant…

Robotics · Computer Science 2025-12-22 Dian Wang , Boce Hu , Shuran Song , Robin Walters , Robert Platt

In recent years, the use of machine learning has become increasingly popular in the context of lattice field theories. An essential element of such theories is represented by symmetries, whose inclusion in the neural network properties can…

High Energy Physics - Lattice · Physics 2021-12-24 Srinath Bulusu , Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

Many classes of images exhibit rotational symmetry. Convolutional neural networks are sometimes trained using data augmentation to exploit this, but they are still required to learn the rotation equivariance properties from the data.…

Machine Learning · Computer Science 2016-05-27 Sander Dieleman , Jeffrey De Fauw , Koray Kavukcuoglu

The dynamics of physical systems is often constrained to lower dimensional sub-spaces due to the presence of conserved quantities. Here we propose a method to learn and exploit such symmetry constraints building upon Hamiltonian Neural…

Machine Learning · Computer Science 2021-04-30 Marc Syvaeri , Sven Krippendorf

Machine learning is offering powerful new tools for the development and discovery of reduced models of nonlinear, multiscale plasma dynamics from the data of first-principles kinetic simulations. However, ensuring the physical consistency…

Plasma Physics · Physics 2026-02-25 Madox C. McGrae-Menge , Jacob R. Pierce , Frederico Fiuza , E. Paulo Alves

Recent advances in deep learning and Transformers have driven major breakthroughs in robotics by employing techniques such as imitation learning, reinforcement learning, and LLM-based multimodal perception and decision-making. However,…

Equivariant deep learning architectures exploit symmetries in learning problems to improve the sample efficiency of neural-network-based models and their ability to generalise. However, when modelling real-world data, learning problems are…

Machine Learning · Statistics 2024-11-12 Matthew Ashman , Cristiana Diaconu , Adrian Weller , Wessel Bruinsma , Richard E. Turner

Equivariant neural networks incorporate symmetries into their architecture, achieving higher generalization performance. However, constructing equivariant neural networks typically requires prior knowledge of data types and symmetries,…

Machine Learning · Computer Science 2024-10-15 Lexiang Hu , Yikang Li , Zhouchen Lin

Learning representations through deep generative modeling is a powerful approach for dynamical modeling to discover the most simplified and compressed underlying description of the data, to then use it for other tasks such as prediction.…

Machine Learning · Computer Science 2022-03-01 Bahar Azari , Deniz Erdoğmuş

Many successful deep learning architectures are equivariant to certain transformations in order to conserve parameters and improve generalization: most famously, convolution layers are equivariant to shifts of the input. This approach only…

Machine Learning · Computer Science 2021-03-31 Allan Zhou , Tom Knowles , Chelsea Finn

Due to the abundance of 2D product images from the Internet, developing efficient and scalable algorithms to recover the missing depth information is central to many applications. Recent works have addressed the single-view depth estimation…

Computer Vision and Pattern Recognition · Computer Science 2016-06-13 Guilin Liu , Chao Yang , Zimo Li , Duygu Ceylan , Qixing Huang

Symmetry is present throughout nature and continues to play an increasingly central role in physics and machine learning. Fundamental symmetries, such as Poincar\'{e} invariance, allow physical laws discovered in laboratories on Earth to be…

Machine Learning · Computer Science 2025-06-13 Samuel E. Otto , Nicholas Zolman , J. Nathan Kutz , Steven L. Brunton

In recent years, deep learning techniques have shown great success in various tasks related to inverse problems, where a target quantity of interest can only be observed through indirect measurements by a forward operator. Common approaches…

Numerical Analysis · Mathematics 2024-03-18 Matthias Beckmann , Nick Heilenkötter

We study the approximation of functions which are invariant with respect to certain permutations of the input indices using flow maps of dynamical systems. Such invariant functions includes the much studied translation-invariant ones…

Machine Learning · Computer Science 2022-08-19 Qianxiao Li , Ting Lin , Zuowei Shen

Geometric Deep Learning (GDL) unifies a broad class of machine learning techniques from the perspectives of symmetries, offering a framework for introducing problem-specific inductive biases like Graph Neural Networks (GNNs). However, the…

Machine Learning · Computer Science 2024-08-29 Osvaldo Velarde , Lucas Parra , Paolo Boldi , Hernan Makse

Symmetry is a fundamental aspect of many real-world robotic tasks. However, current deep reinforcement learning (DRL) approaches can seldom harness and exploit symmetry effectively. Often, the learned behaviors fail to achieve the desired…

Robotics · Computer Science 2024-03-08 Mayank Mittal , Nikita Rudin , Victor Klemm , Arthur Allshire , Marco Hutter

Geophysical inversion attempts to estimate the distribution of physical properties in the Earth's interior from observations collected at or above the surface. Inverse problems are commonly posed as least-squares optimization problems in…

Geophysics · Physics 2019-05-22 Vladimir Puzyrev

Image restoration is an inherently ill posed inverse problem. Equivariant networks that embed geometric symmetry priors can mitigate this ill posedness and improve performance. However, current understanding of the relationship between…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Feiyu Tan , Qi Xie , Zongben Xu , Deyu Meng

Incorporating Euclidean symmetries (e.g. rotation equivariance) as inductive biases into graph neural networks has improved their generalization ability and data efficiency in unbounded physical dynamics modeling. However, in various…

Machine Learning · Computer Science 2024-06-25 Zinan Zheng , Yang Liu , Jia Li , Jianhua Yao , Yu Rong

Equivariance of neural networks to transformations helps to improve their performance and reduce generalization error in computer vision tasks, as they apply to datasets presenting symmetries (e.g. scalings, rotations, translations). The…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Mateus Sangalli , Samy Blusseau , Santiago Velasco-Forero , Jesus Angulo