English
Related papers

Related papers: Group invariant machine learning by fundamental do…

200 papers

Euclidean deep learning is often inadequate for addressing real-world signals where the representation space is irregular and curved with complex topologies. Interpreting the geometric properties of such feature spaces has become paramount…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Ramzan Basheer , Deepak Mishra

We survey the mathematical foundations of geometric deep learning, focusing on group equivariant and gauge equivariant neural networks. We develop gauge equivariant convolutional neural networks on arbitrary manifolds $\mathcal{M}$ using…

Many scientific problems require to process data in the form of geometric graphs. Unlike generic graph data, geometric graphs exhibit symmetries of translations, rotations, and/or reflections. Researchers have leveraged such inductive bias…

Machine Learning · Computer Science 2022-02-23 Jiaqi Han , Yu Rong , Tingyang Xu , Wenbing Huang

In many real-world applications of regression, conditional probability estimation, and uncertainty quantification, exploiting symmetries rooted in physics or geometry can dramatically improve generalization and sample efficiency. While…

Machine Learning · Computer Science 2025-05-28 Daniel Ordoñez-Apraez , Vladimir Kostić , Alek Fröhlich , Vivien Brandt , Karim Lounici , Massimiliano Pontil

Invariance has recently proven to be a powerful inductive bias in machine learning models. One such class of predictive or generative models are tensor networks. We introduce a new numerical algorithm to construct a basis of tensors that…

Machine Learning · Computer Science 2024-07-02 Brent Sprangers , Nick Vannieuwenhoven

We study how group symmetry helps improve data efficiency and generalization for end-to-end differentiable planning algorithms when symmetry appears in decision-making tasks. Motivated by equivariant convolution networks, we treat the path…

Machine Learning · Computer Science 2023-05-02 Linfeng Zhao , Xupeng Zhu , Lingzhi Kong , Robin Walters , Lawson L. S. Wong

Rotational symmetry is a defining feature of many tomography systems, including computed tomography (CT) and emission computed tomography (ECT), where detectors are arranged in a circular or periodically rotating configuration. This study…

Medical Physics · Physics 2025-02-05 Yaogong Zhang , Fang-Fang Yin , Lei Zhang

Statistical models that possess symmetry arise in diverse settings such as random fields associated to geophysical phenomena, exchangeable processes in Bayesian statistics, and cyclostationary processes in engineering. We formalize the…

Statistics Theory · Mathematics 2011-12-01 Parikshit Shah , Venkat Chandrasekaran

Many quantities we are interested in predicting are geometric tensors; we refer to this class of problems as geometric prediction. Attempts to perform geometric prediction in real-world scenarios have been limited to approximating them…

Machine Learning · Computer Science 2020-06-26 Raphael J. L. Townshend , Brent Townshend , Stephan Eismann , Ron O. Dror

Equivariant neural networks, whose hidden features transform according to representations of a group G acting on the data, exhibit training efficiency and an improved generalisation performance. In this work, we extend group invariant and…

Machine Learning · Computer Science 2024-04-15 Robin Winter , Marco Bertolini , Tuan Le , Frank Noé , Djork-Arné Clevert

This paper presents a differential geometric control approach that leverages SE(3) group invariance and equivariance to increase transferability in learning robot manipulation tasks that involve interaction with the environment.…

Deep Neural Networks achieve state-of-the-art results in many different problem settings by exploiting vast amounts of training data. However, collecting, storing and - in the case of supervised learning - labelling the data is expensive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Matthias Rath , Alexandru Paul Condurache

Group equivariant neural networks have been explored in the past few years and are interesting from theoretical and practical standpoints. They leverage concepts from group representation theory, non-commutative harmonic analysis and…

Machine Learning · Computer Science 2020-05-01 Carlos Esteves

From early image processing to modern computational imaging, successful models and algorithms have relied on a fundamental property of natural signals: symmetry. Here symmetry refers to the invariance property of signal sets to…

Signal Processing · Electrical Eng. & Systems 2022-09-07 Dongdong Chen , Mike Davies , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb , Ferdia Sherry , Julián Tachella

The dictionary learning problem concerns the task of representing data as sparse linear sums drawn from a smaller collection of basic building blocks. In application domains where such techniques are deployed, we frequently encounter…

Signal Processing · Electrical Eng. & Systems 2021-07-21 Yong Sheng Soh

Recent advances in deep learning and Transformers have driven major breakthroughs in robotics by employing techniques such as imitation learning, reinforcement learning, and LLM-based multimodal perception and decision-making. However,…

In recent years the use of convolutional layers to encode an inductive bias (translational equivariance) in neural networks has proven to be a very fruitful idea. The successes of this approach have motivated a line of research into…

Physical theories grounded in mathematical symmetries are an essential component of our understanding of a wide range of properties of the universe. Similarly, in the domain of machine learning, an awareness of symmetries such as rotation…

In this paper we consider the problem of group invariant subspace clustering where the data is assumed to come from a union of group-invariant subspaces of a vector space, i.e. subspaces which are invariant with respect to action of a given…

Information Theory · Computer Science 2015-10-16 Shuchin Aeron , Eric Kernfeld

Machine learning problems have an intrinsic geometric structure as central objects including a neural network's weight space and the loss function associated with a particular task can be viewed as encoding the intrinsic geometry of a given…

Machine Learning · Computer Science 2021-06-08 Guruprasad Raghavan , Matt Thomson
‹ Prev 1 2 3 10 Next ›