English
Related papers

Related papers: Machine learning a manifold

200 papers

Neural networks are one of the most popularly used methods in machine learning and artificial intelligence nowadays. Due to the universal approximation theorem (Hornik et al. (1989)), a neural network with one hidden layer can approximate…

Statistics Theory · Mathematics 2019-09-18 Xiaoxi Shen , Chang Jiang , Lyudmila Sakhanenko , Qing Lu

We implement two algorithms in MATHEMATICA for classifying automorphisms of lower-dimensional non-commutative Lie algebras. The first algorithm is a brute-force approach whereas the second is an evolutionary strategy. These algorithms are…

Rings and Algebras · Mathematics 2017-05-10 C. Wafo Soh

Symmetries are key properties of physical models and of experimental designs, but any proposed symmetry may or may not be realized in nature. In this paper, we introduce a practical and general method to test such suspected symmetries in…

High Energy Physics - Phenomenology · Physics 2022-08-25 Rupert Tombs , Christopher G. Lester

We propose a geometric numerical analysis of SDEs admitting Lie symmetries which allows us to individuate a symmetry adapted coordinates system where the given SDE has notable invariant properties. An approximation scheme preserving the…

Probability · Mathematics 2020-08-04 Francesco C. De Vecchi , Andrea Romano , Stefania Ugolini

Recent innovations from machine learning allow for data unfolding, without binning and including correlations across many dimensions. We describe a set of known, upgraded, and new methods for ML-based unfolding. The performance of these…

We formulate a strong equivalence between machine learning, artificial intelligence methods and the formulation of statistical data assimilation as used widely in physical and biological sciences. The correspondence is that layer number in…

Artificial Intelligence · Computer Science 2017-07-06 Henry Abarbanel , Paul Rozdeba , Sasha Shirman

In this paper, we explore a self-supervised model that learns to detect the symmetry of a single object without requiring a dataset-relying solely on the input object itself. We hypothesize that the symmetry of an object can be determined…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Isaac Aguirre , Ivan Sipiran , Gabriel Montañana

Lie symmetry analysis is one of the powerful tools to analyze nonlinear ordinary differential equations. We review the effectiveness of this method in terms of various symmetries. We present the method of deriving Lie point symmetries,…

Exactly Solvable and Integrable Systems · Physics 2023-07-19 M. Senthilvelan , V. K. Chandrasekar , R. Mohanasubha

Existing equivariant neural networks require prior knowledge of the symmetry group and discretization for continuous groups. We propose to work with Lie algebras (infinitesimal generators) instead of Lie groups. Our model, the Lie algebra…

Machine Learning · Computer Science 2021-11-03 Nima Dehmamy , Robin Walters , Yanchen Liu , Dashun Wang , Rose Yu

Symmetries built into a neural network have appeared to be very beneficial for a wide range of tasks as it saves the data to learn them. We depart from the position that when symmetries are not built into a model a priori, it is…

Machine Learning · Computer Science 2023-02-01 Artem Moskalev , Anna Sepliarskaia , Ivan Sosnovik , Arnold Smeulders

A common belief in high-dimensional data analysis is that data are concentrated on a low-dimensional manifold. This motivates simultaneous dimension reduction and regression on manifolds. We provide an algorithm for learning gradients on…

Statistics Theory · Mathematics 2010-02-24 Sayan Mukherjee , Qiang Wu , Ding-Xuan Zhou

Lie symmetry analysis provides a general theoretical framework for investigating ordinary and partial differential equations. The theory is completely algorithmic even if it usually involves lengthy computations. For this reason, many…

Mathematical Software · Computer Science 2021-05-26 Francesco Oliveri

Group convolutional neural networks are a useful tool for utilizing symmetries known to be in a signal; however, they require that the signal is defined on the group itself. Existing approaches either work directly with group signals, or…

Signal Processing · Electrical Eng. & Systems 2022-11-01 Harshat Kumar , Alejandro Parada-Mayorga , Alejandro Ribeiro

Nonlinear dimensionality reduction methods provide a valuable means to visualize and interpret high-dimensional data. However, many popular methods can fail dramatically, even on simple two-dimensional manifolds, due to problems such as…

Machine Learning · Statistics 2020-07-08 Daniel Ting , Michael I. Jordan

Meshes are ubiquitous in visual computing and simulation, yet most existing machine learning techniques represent meshes only indirectly, e.g. as the level set of a scalar field or deformation of a template, or as a disordered triangle soup…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Tianchang Shen , Zhaoshuo Li , Marc Law , Matan Atzmon , Sanja Fidler , James Lucas , Jun Gao , Nicholas Sharp

We identify a strong equivalence between neural network based machine learning (ML) methods and the formulation of statistical data assimilation (DA), known to be a problem in statistical physics. DA, as used widely in physical and…

Machine Learning · Computer Science 2017-10-23 H. D. I. Abarbanel , P. J. Rozdeba , S. Shirman

Linear regression is a data analysis technique, which is categorized as supervised learning. By utilizing known data, we can predict unknown data. Recently, researchers have explored the use of quantum annealing (QA) to perform linear…

Quantum Physics · Physics 2024-10-14 Asuka Koura , Takashi Imoto , Katsuki Ura , Yuichiro Matsuzaki

The increasing use of machine-learning (ML) enabled systems in critical tasks fuels the quest for novel verification and validation techniques yet grounded in accepted system assurance principles. In traditional system development,…

Machine Learning · Computer Science 2020-02-11 Taejoon Byun , Sanjai Rayadurgam

We prove that any potential symmetry of a system of evolution equations reduces to a Lie symmetry through a nonlocal transformation of variables. Based on this fact is our method of group classification of potential symmetries of systems of…

Exactly Solvable and Integrable Systems · Physics 2009-06-18 Renat Zhdanov

We adapt a manifold sampling algorithm for the nonsmooth, nonconvex formulations of learning that arise when imposing robustness to outliers present in the training data. We demonstrate the approach on objectives based on trimmed loss.…

Optimization and Control · Mathematics 2018-07-10 Matt Menickelly , Stefan M. Wild