English
Related papers

Related papers: Steerable Partial Differential Operators for Equiv…

200 papers

With the emergence of powerful representations of continuous data in the form of neural fields, there is a need for discretization invariant learning: an approach for learning maps between functions on continuous domains without being…

Machine Learning · Computer Science 2023-10-23 Clinton J. Wang , Polina Golland

In scientific and engineering applications, solving partial differential equations (PDEs) across various parameters and domains normally relies on resource-intensive numerical methods. Neural operators based on deep learning offered a…

Numerical Analysis · Mathematics 2024-06-21 Zhiwei Zhao , Changqing Liu , Yingguang Li , Zhibin Chen , Xu Liu

Although very successfully used in conventional machine learning, convolution based neural network architectures -- believed to be inconsistent in function space -- have been largely ignored in the context of learning solution operators of…

Recent attempts at introducing rotation invariance or equivariance in 3D deep learning approaches have shown promising results, but these methods still struggle to reach the performances of standard 3D neural networks. In this work we study…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Hugues Thomas

Establishing correspondences between 3D shapes is a fundamental task in 3D Computer Vision, typically addressed by matching local descriptors. Recently, a few attempts at applying the deep learning paradigm to the task have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Riccardo Spezialetti , Samuele Salti , Luigi Di Stefano

Motivated by objects such as electric fields or fluid streams, we study the problem of learning stochastic fields, i.e. stochastic processes whose samples are fields like those occurring in physics and engineering. Considering general…

Machine Learning · Computer Science 2021-07-20 Peter Holderrieth , Michael Hutchinson , Yee Whye Teh

State-of-the-art deep learning systems often require large amounts of data and computation. For this reason, leveraging known or unknown structure of the data is paramount. Convolutional neural networks (CNNs) are successful examples of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Carlos Esteves

Recently, learning equivariant representations has attracted considerable research attention. Dieleman et al. introduce four operations which can be inserted into convolutional neural network to learn deep representations equivariant to…

Computer Vision and Pattern Recognition · Computer Science 2018-03-01 Junying Li , Zichen Yang , Haifeng Liu , Deng Cai

We develop theory and software for rotation equivariant operators on scalar and vector fields, with diverse applications in simulation, optimization and machine learning. Rotation equivariance (covariance) means all fields in the system…

Machine Learning · Computer Science 2022-08-08 Paul Shen , Michael Herbst , Venkat Viswanathan

We study how group symmetry helps improve data efficiency and generalization for end-to-end differentiable planning algorithms when symmetry appears in decision-making tasks. Motivated by equivariant convolution networks, we treat the path…

Machine Learning · Computer Science 2023-05-02 Linfeng Zhao , Xupeng Zhu , Lingzhi Kong , Robin Walters , Lawson L. S. Wong

Existing architectures for operator learning require that the number and locations of sensors (where the input functions are evaluated) remain the same across all training and test samples, significantly restricting the range of their…

Machine Learning · Computer Science 2022-05-24 Michael Prasthofer , Tim De Ryck , Siddhartha Mishra

Group equivariant neural networks have been explored in the past few years and are interesting from theoretical and practical standpoints. They leverage concepts from group representation theory, non-commutative harmonic analysis and…

Machine Learning · Computer Science 2020-05-01 Carlos Esteves

Traditional supervised learning aims to learn an unknown mapping by fitting a function to a set of input-output pairs with a fixed dimension. The fitted function is then defined on inputs of the same dimension. However, in many settings,…

Machine Learning · Computer Science 2024-05-01 Eitan Levin , Mateo Díaz

Invariance under symmetry is an important problem in machine learning. Our paper looks specifically at equivariant neural networks where transformations of inputs yield homomorphic transformations of outputs. Here, steerable CNNs have…

Machine Learning · Computer Science 2021-09-15 Daniel Franzen , Michael Wand

Including covariant information, such as position, force, velocity or spin is important in many tasks in computational physics and chemistry. We introduce Steerable E(3) Equivariant Graph Neural Networks (SEGNNs) that generalise equivariant…

Machine Learning · Computer Science 2022-03-29 Johannes Brandstetter , Rob Hesselink , Elise van der Pol , Erik J Bekkers , Max Welling

Operator learning refers to the application of ideas from machine learning to approximate (typically nonlinear) operators mapping between Banach spaces of functions. Such operators often arise from physical models expressed in terms of…

Machine Learning · Computer Science 2024-02-27 Nikola B. Kovachki , Samuel Lanthaler , Andrew M. Stuart

Spectral methods are an important part of scientific computing's arsenal for solving partial differential equations (PDEs). However, their applicability and effectiveness depend crucially on the choice of basis functions used to expand the…

Numerical Analysis · Mathematics 2021-11-10 Brek Meuris , Saad Qadeer , Panos Stinis

We present an alternative way of solving the steerable kernel constraint that appears in the design of steerable equivariant convolutional neural networks. We find explicit real and complex bases which are ready to use, for different…

Machine Learning · Computer Science 2026-03-16 Alan Garbarz

This paper introduces a data-driven operator learning method for multiscale partial differential equations, with a particular emphasis on preserving high-frequency information. Drawing inspiration from the representation of multiscale…

Machine Learning · Computer Science 2024-08-05 Bo Xu , Xinliang Liu , Lei Zhang

In many machine learning tasks it is desirable that a model's prediction transforms in an equivariant way under transformations of its input. Convolutional neural networks (CNNs) implement translational equivariance by construction; for…

Machine Learning · Computer Science 2018-03-20 Maurice Weiler , Fred A. Hamprecht , Martin Storath