English
Related papers

Related papers: A Single Architecture for Representing Invariance …

200 papers

Symmetry principles underlie and guide scientific theory and research, from Curie's invariance formulation to modern applications across physics, chemistry, and mathematics. Building on a recent matrix Lie group measurement model, this…

Methodology · Statistics 2025-12-19 William R. Nugent

Invariance under symmetry is an important problem in machine learning. Our paper looks specifically at equivariant neural networks where transformations of inputs yield homomorphic transformations of outputs. Here, steerable CNNs have…

Machine Learning · Computer Science 2021-09-15 Daniel Franzen , Michael Wand

In this paper, we investigate properties and limitations of invariance learned by neural networks from the data compared to the genuine invariance achieved through invariant weight-tying. To do so, we adopt a group theoretical perspective…

Machine Learning · Computer Science 2023-08-09 Artem Moskalev , Anna Sepliarskaia , Erik J. Bekkers , Arnold Smeulders

Symmetry transformations induce invariances which are frequently described with deep latent variable models. In many complex domains, such as the chemical space, invariances can be observed, yet the corresponding symmetry transformation…

Machine Learning · Computer Science 2020-10-23 Mario Wieser , Sonali Parbhoo , Aleksander Wieczorek , Volker Roth

In this paper, using 1+1D models as examples, we study symmetries and anomalous symmetries via multi-component partition functions obtained through symmetry twists, and their transformations under the mapping class group of spacetime. This…

Strongly Correlated Electrons · Physics 2022-03-10 Wenjie Ji , Xiao-Gang Wen

The dictionary learning problem can be viewed as a data-driven process to learn a suitable transformation so that data is sparsely represented directly from example data. In this paper, we examine the problem of learning a dictionary that…

Optimization and Control · Mathematics 2026-02-05 Subhroshekhar Ghosh , Aaron Y. R. Low , Yong Sheng Soh , Zhuohang Feng , Brendan K. Y. Tan

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

This paper introduces a new Convolutional Neural Network (ConvNet) architecture inspired by a class of partial differential equations (PDEs) called quasi-linear hyperbolic systems. With comparable performance on the image classification…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Yao Liu , Hang Shao , Bing Bai

The introduction of convolutional layers greatly advanced the performance of neural networks on image tasks due to innately capturing a way of encoding and learning translation-invariant operations, matching one of the underlying symmetries…

Computer Vision and Pattern Recognition · Computer Science 2016-12-15 Nicholas Guttenberg , Nathaniel Virgo , Olaf Witkowski , Hidetoshi Aoki , Ryota Kanai

To leverage advancements in machine learning for metallic materials design and property prediction, it is crucial to develop a data-reduced representation of metal microstructures that surpasses the limitations of current physics-based…

Learning physical simulations has been an essential and central aspect of many recent research efforts in machine learning, particularly for Navier-Stokes-based fluid mechanics. Classic numerical solvers have traditionally been…

Machine Learning · Computer Science 2024-03-26 Rene Winchenbach , Nils Thuerey

Learning robust models under distribution shifts between training and test datasets is a fundamental challenge in machine learning. While learning invariant features across environments is a popular approach, it often assumes that these…

Machine Learning · Computer Science 2025-09-15 Taero Kim , Subeen Park , Sungjun Lim , Yonghan Jung , Krikamol Muandet , Kyungwoo Song

Physics-informed machine learning is gaining significant traction for enhancing statistical performance and sample efficiency through the integration of physical knowledge. However, current theoretical analyses often presume complete prior…

Machine Learning · Computer Science 2025-09-17 Takeshi Koshizuka , Issei Sato

Visual Place Recognition (VPR) demands representations robust to drastic environmental and viewpoint shifts. Existing aggregation paradigms either depend on extensive supervised training or rely on first-order pooling, often struggling to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Jintao Cheng , Weibin Li , Zhijian He , Jin Wu , Chi Man Vong , Wei Zhang

We introduce a machine-learning approach (denoted Symmetry Seeker Neural Network) capable of automatically discovering discrete symmetry groups in physical systems. This method identifies the finite set of parameter transformations that…

Computational Physics · Physics 2023-07-26 Pablo Calvo-Barlés , Sergio G. Rodrigo , Eduardo Sánchez-Burillo , Luis Martín-Moreno

We study how group symmetry helps improve data efficiency and generalization for end-to-end differentiable planning algorithms when symmetry appears in decision-making tasks. Motivated by equivariant convolution networks, we treat the path…

Machine Learning · Computer Science 2023-05-02 Linfeng Zhao , Xupeng Zhu , Lingzhi Kong , Robin Walters , Lawson L. S. Wong

Efficiently predicting properties of porous crystalline materials has great potential to accelerate the high throughput screening process for developing new materials, as simulations carried out using first principles model are often…

Machine Learning · Computer Science 2023-11-30 Marko Petković , Pablo Romero-Marimon , Vlado Menkovski , Sofia Calero

We address the problem of merging graph and feature-space information while learning a metric from structured data. Existing algorithms tackle the problem in an asymmetric way, by either extracting vectorized summaries of the graph…

Machine Learning · Computer Science 2020-02-17 Nicolo Colombo

In this work, we look at the symmetry of normal modes in symmetric structures, particularly structures with cyclic symmetry. We show that normal modes of symmetric structures have different levels of symmetry, or symmetricity. One novel…

Biological Physics · Physics 2016-09-21 Guang Song

Leveraging prior knowledge on intraclass variance due to transformations is a powerful method to improve the sample complexity of deep neural networks. This makes them applicable to practically important use-cases where training data is…

Machine Learning · Computer Science 2022-02-09 Matthias Rath , Alexandru Paul Condurache