English
Related papers

Related papers: Statistical exploration of the Manifold Hypothesis

200 papers

While classical data analysis has addressed observations that are real numbers or elements of a real vector space, at present many statistical problems of high interest in the sciences address the analysis of data that consist of more…

Statistics Theory · Mathematics 2023-08-15 Zhigang Yao , Jiaji Su , Bingjie Li , Shing-Tung Yau

The idea that data lies on a non-linear space has brought up the concept of manifold learning as a part of machine learning.

General Mathematics · Mathematics 2022-02-08 Arif Gursoy

Deep generative networks have been widely used for learning mappings from a low-dimensional latent space to a high-dimensional data space. In many cases, data transformations are defined by linear paths in this latent space. However, the…

Machine Learning · Statistics 2019-12-06 Marissa Connor , Christopher Rozell

Deep neural networks have reshaped modern machine learning by learning powerful latent representations that often align with the manifold hypothesis: high-dimensional data lie on lower-dimensional manifolds. In this paper, we establish a…

Machine Learning · Computer Science 2025-06-09 Nico Pelleriti , Max Zimmer , Elias Wirth , Sebastian Pokutta

Manifold learning seeks a low dimensional representation that faithfully captures the essence of data. Current methods can successfully learn such representations, but do not provide a meaningful set of operations that are associated with…

Machine Learning · Computer Science 2019-08-21 David Eklund , Søren Hauberg

In order to avoid the curse of dimensionality, frequently encountered in Big Data analysis, there was a vast development in the field of linear and nonlinear dimension reduction techniques in recent years. These techniques (sometimes…

Graphics · Computer Science 2020-02-27 Barak Sober , David Levin

Predicting the evolution of systems that exhibit spatio-temporal dynamics in response to external stimuli is a key enabling technology fostering scientific innovation. Traditional equations-based approaches leverage first principles to…

Machine Learning · Computer Science 2023-05-02 Francesco Regazzoni , Stefano Pagani , Matteo Salvador , Luca Dede' , Alfio Quarteroni

Active area of research in AI is the theory of manifold learning and finding lower-dimensional manifold representation on how we can learn geometry from data for providing better quality curated datasets. There are however various issues…

Machine Learning · Computer Science 2024-10-16 Liubov Tupikina , Kathuria Hritika

The methods of Information geometry have been glowing up to develop various subjects of theoretical physics, including quantum information systems. The present article has two purposes. The first one is to develop general theory of…

Differential Geometry · Mathematics 2024-08-06 Jun-ichi Inoguchi , Yu Ohno

The manifold hypothesis posits that high-dimensional data typically resides on low-dimensional sub spaces. In this paper, we assume manifold hypothesis to investigate graph-based semi-supervised learning methods. In particular, we examine…

Machine Learning · Computer Science 2025-11-18 Mary Chriselda Antony Oliver , Michael Roberts , Carola-Bibiane Schönlieb , Matthew Thorpe

A common belief in high-dimensional data analysis is that data are concentrated on a low-dimensional manifold. This motivates simultaneous dimension reduction and regression on manifolds. We provide an algorithm for learning gradients on…

Statistics Theory · Mathematics 2010-02-24 Sayan Mukherjee , Qiang Wu , Ding-Xuan Zhou

Graph Neural Networks (GNNs) have gained popularity in various learning tasks, with successful applications in fields like molecular biology, transportation systems, and electrical grids. These fields naturally use graph data, benefiting…

Machine Learning · Computer Science 2024-09-23 Caio F. Deberaldini Netto , Zhiyang Wang , Luana Ruiz

The manifold hypothesis presumes that high-dimensional data lies on or near a low-dimensional manifold. While the utility of encoding geometric structure has been demonstrated empirically, rigorous analysis of its impact on the learnability…

Machine Learning · Computer Science 2024-06-04 Bobak T. Kiani , Jason Wang , Melanie Weber

Hierarchical learning models, such as mixture models and Bayesian networks, are widely employed for unsupervised learning tasks, such as clustering analysis. They consist of observable and hidden variables, which represent the given data…

Machine Learning · Statistics 2018-01-08 Keisuke Yamazaki

We consider the ability of deep neural networks to represent data that lies near a low-dimensional manifold in a high-dimensional space. We show that deep networks can efficiently extract the intrinsic, low-dimensional coordinates of such…

Neural and Evolutionary Computing · Computer Science 2016-02-16 Ronen Basri , David Jacobs

The increasing prevalence of relational data describing interactions among a target population has motivated a wide literature on statistical network analysis. In many applications, interactions may involve more than two members of the…

Methodology · Statistics 2021-11-03 Kathryn Turnbull , Simón Lunagómez , Christopher Nemeth , Edoardo Airoldi

High-dimensional datasets often exhibit low-dimensional geometric structures, as suggested by the manifold hypothesis, which implies that data lie on a smooth manifold embedded in a higher-dimensional ambient space. While this insight…

Machine Learning · Computer Science 2025-07-11 Paola Causin , Alessio Marta

The commonly used latent space embedding techniques, such as Principal Component Analysis, Factor Analysis, and manifold learning techniques, are typically used for learning effective representations of homogeneous data. However, they do…

Machine Learning · Computer Science 2021-10-04 Yasin Yilmaz , Mehmet Aktukmak , Alfred O. Hero

While the manifold hypothesis is widely adopted in modern machine learning, complex data is often better modeled as stratified spaces -- unions of manifolds (strata) of varying dimensions. Stratified learning is challenging due to varying…

Machine Learning · Statistics 2026-04-14 Randy Martinez , Rong Tang , Lizhen Lin

Many techniques in machine learning attempt explicitly or implicitly to infer a low-dimensional manifold structure of an underlying physical phenomenon from measurements without an explicit model of the phenomenon or the measurement…

Machine Learning · Statistics 2023-07-04 Roy R. Lederman , Bogdan Toader