English
Related papers

Related papers: Linear Regression on Manifold Structured Data: the…

200 papers

We introduce an intrinsic estimator for the scalar curvature of a data set presented as a finite metric space. Our estimator depends only on the metric structure of the data and not on an embedding in $\mathbb{R}^n$. We show that the…

Machine Learning · Statistics 2023-08-14 Abigail Hickok , Andrew J. Blumberg

The Euclidean scattering transform was introduced nearly a decade ago to improve the mathematical understanding of the success of convolutional neural networks (ConvNets) in image data analysis and other tasks. Inspired by recent interest…

Machine Learning · Statistics 2019-06-06 Michael Perlmutter , Guy Wolf , Matthew Hirn

In this paper, we consider a surrogate modeling approach using a data-driven nonparametric likelihood function constructed on a manifold on which the data lie (or to which they are close). The proposed method represents the likelihood…

Data Analysis, Statistics and Probability · Physics 2019-06-04 Shixiao W. Jiang , John Harlim

In graph representation learning, it is important that the complex geometric structure of the input graph, e.g. hidden relations among nodes, is well captured in embedding space. However, standard Euclidean embedding spaces have a limited…

Machine Learning · Computer Science 2023-07-11 Tuc Nguyen-Van , Dung D. Le , The-Anh Ta

When analyzing parametric statistical models, a useful approach consists in modeling geometrically the parameter space. However, even for very simple and commonly used hierarchical models like statistical mixtures or stochastic deep neural…

Machine Learning · Computer Science 2021-12-08 Pascal Mattia Esser , Frank Nielsen

Unstructured grid data are essential for modelling complex geometries and dynamics in computational physics. Yet, their inherent irregularity presents significant challenges for conventional machine learning (ML) techniques. This paper…

To address the challenges of long-tailed classification, researchers have proposed several approaches to reduce model bias, most of which assume that classes with few samples are weak classes. However, recent studies have shown that tail…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yanbiao Ma , Licheng Jiao , Fang Liu , Maoji Wen , Lingling Li , Wenping Ma , Shuyuan Yang , Xu Liu , Puhua Chen

Uncertainty is the only certainty there is. Modeling data uncertainty is essential for regression, especially in unconstrained settings. Traditionally the direct regression formulation is considered and the uncertainty is modeled by…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Wanhua Li , Xiaoke Huang , Jiwen Lu , Jianjiang Feng , Jie Zhou

We address the problem of estimating topological features from data in high dimensional Euclidean spaces under the manifold assumption. Our approach is based on the computation of persistent homology of the space of data points endowed with…

Machine Learning · Statistics 2023-01-23 Ximena Fernández , Eugenio Borghini , Gabriel Mindlin , Pablo Groisman

Data-driven Riemannian geometry has emerged as a powerful tool for interpretable representation learning, offering improved efficiency in downstream tasks. Moving forward, it is crucial to balance cheap manifold mappings with efficient…

Machine Learning · Computer Science 2025-05-26 Willem Diepeveen , Georgios Batzolis , Zakhar Shumaylov , Carola-Bibiane Schönlieb

Data sets tend to live in low-dimensional non-linear subspaces. Ideal data analysis tools for such data sets should therefore account for such non-linear geometry. The symmetric Riemannian geometry setting can be suitable for a variety of…

Differential Geometry · Mathematics 2024-03-12 Willem Diepeveen

Deep learning methods have played a more and more important role in hyperspectral image classification. However, the general deep learning methods mainly take advantage of the information of sample itself or the pairwise information between…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Zhiqiang Gong , Weidong Hu , Xiaoyong Du , Ping Zhong , Panhe Hu

We propose extrinsic and intrinsic deep neural network architectures as general frameworks for deep learning on manifolds. Specifically, extrinsic deep neural networks (eDNNs) preserve geometric features on manifolds by utilizing an…

Machine Learning · Statistics 2023-02-20 Yihao Fang , Ilsang Ohn , Vijay Gupta , Lizhen Lin

Manifold embedding algorithms map high-dimensional data down to coordinates in a much lower-dimensional space. One of the aims of dimension reduction is to find intrinsic coordinates that describe the data manifold. The coordinates returned…

Machine Learning · Statistics 2021-07-30 Samson Koelle , Hanyu Zhang , Marina Meila , Yu-Chia Chen

Modern information processing relies on the axiom that high-dimensional data lie near low-dimensional geometric structures. This paper revisits the problem of data-driven learning of these geometric structures and puts forth two new…

Machine Learning · Statistics 2018-03-06 Tong Wu , Waheed U. Bajwa

Consider a set of $n$ data points in the Euclidean space $\mathbb{R}^d$. This set is called dataset in machine learning and data science. Manifold hypothesis states that the dataset lies on a low-dimensional submanifold with high…

Machine Learning · Computer Science 2022-02-04 Benyamin Ghojogh , Fakhri Karray , Mark Crowley

Deep Neural Networks are widely used for solving complex problems in several scientific areas, such as speech recognition, machine translation, image analysis. The strategies employed to investigate their theoretical properties mainly rely…

Machine Learning · Computer Science 2022-09-26 Alessandro Benfenati , Alessio Marta

Many tasks require mapping continuous input data (e.g. images) to discrete task outputs (e.g. class labels). Yet, how neural networks learn to perform such discrete computations on continuous data manifolds remains poorly understood. Here,…

Machine Learning · Computer Science 2025-12-02 Julian Brandon , Angus Chadwick , Arthur Pellegrino

Establishing Lipschitz stability estimates is crucial for ensuring the mathematical robustness of neural network (NN) approximations in machine learning (ML)-based parameter estimation, particularly in physics-informed settings. In this…

Numerical Analysis · Mathematics 2025-11-25 Mahadevan Ganesh , Stuart C. Hawkins , Darko Volkov

Recent numerical experiments have demonstrated that the choice of optimization geometry used during training can impact generalization performance when learning expressive nonlinear model classes such as deep neural networks. These…

Machine Learning · Computer Science 2022-04-25 Nicholas M. Boffi , Stephen Tu , Jean-Jacques E. Slotine