English
Related papers

Related papers: Linear Regression on Manifold Structured Data: the…

200 papers

Gaussian processes (GPs) are very widely used for modeling of unknown functions or surfaces in applications ranging from regression to classification to spatial processes. Although there is an increasingly vast literature on applications,…

Methodology · Statistics 2017-06-28 Lizhen Lin , Mu Niu , Pokman Cheung , David Dunson

Despite significant advances in the field of deep learning in applications to various fields, explaining the inner processes of deep learning models remains an important and open question. The purpose of this article is to describe and…

Machine Learning · Computer Science 2022-04-20 German Magai , Anton Ayzenberg

The manifold hypothesis, which assumes that data lies on or close to an unknown manifold of low intrinsic dimension, is a staple of modern machine learning research. However, recent work has shown that real-world data exhibits distinct…

Machine Learning · Computer Science 2023-06-16 Julius von Rohrscheidt , Bastian Rieck

Large longitudinal studies provide lots of valuable information, especially in medical applications. A problem which must be taken care of in order to utilize their full potential is that of correlation between intra-subject measurements…

Methodology · Statistics 2022-02-14 Martin Hanik , Hans-Christian Hege , Christoph von Tycowicz

The merit of projecting data onto linear subspaces is well known from, e.g., dimension reduction. One key aspect of subspace projections, the maximum preservation of variance (principal component analysis), has been thoroughly researched…

Machine Learning · Computer Science 2022-09-27 Erik Thordsen , Erich Schubert

Manifold learning is a popular and quickly-growing subfield of machine learning based on the assumption that one's observed data lie on a low-dimensional manifold embedded in a higher-dimensional space. This thesis presents a mathematical…

Machine Learning · Computer Science 2020-11-04 Luke Melas-Kyriazi

Diffusion models have become a leading framework in generative modeling, yet their theoretical understanding -- especially for high-dimensional data concentrated on low-dimensional structures -- remains incomplete. This paper investigates…

Machine Learning · Computer Science 2026-04-29 Zixuan Zhang , Kaixuan Huang , Tuo Zhao , Mengdi Wang , Minshuo Chen

Modern machine learning increasingly leverages the insight that high-dimensional data often lie near low-dimensional, non-linear manifolds, an idea known as the manifold hypothesis. By explicitly modeling the geometric structure of data…

Machine Learning · Computer Science 2026-03-02 Willem Diepeveen , Deanna Needell

Manifold learning is a hot research topic in the field of computer science and has many applications in the real world. A main drawback of manifold learning methods is, however, that there is no explicit mappings from the input data…

Computer Vision and Pattern Recognition · Computer Science 2010-01-18 Hong Qiao , Peng Zhang , Di Wang , Bo Zhang

Intrinsic and parametric regression models are of high interest for the statistical analysis of manifold-valued data such as images and shapes. The standard linear ansatz has been generalized to geodesic regression on manifolds making it…

Optimization and Control · Mathematics 2020-10-19 Martin Hanik , Hans-Christian Hege , Anaja Hennemuth , Christoph von Tycowicz

Embedding graphs in continous spaces is a key factor in designing and developing algorithms for automatic information extraction to be applied in diverse tasks (e.g., learning, inferring, predicting). The reliability of graph embeddings…

Machine Learning · Computer Science 2023-11-30 Andrea Marinoni , Pietro Lio' , Alessandro Barp , Christian Jutten , Mark Girolami

High-dimensional data analysis has been an active area, and the main focuses have been variable selection and dimension reduction. In practice, it occurs often that the variables are located on an unknown, lower-dimensional nonlinear…

Statistics Theory · Mathematics 2012-07-31 Ming-Yen Cheng , Hau-tieng Wu

The neural manifold hypothesis postulates that the activity of a neural population forms a low-dimensional manifold whose structure reflects that of the encoded task variables. In this work, we combine topological deep generative models and…

Neurons and Cognition · Quantitative Biology 2023-04-26 Francisco Acosta , Sophia Sanborn , Khanh Dao Duc , Manu Madhav , Nina Miolane

Fr\'echet regression extends classical regression methods to non-Euclidean metric spaces, enabling the analysis of data relationships on complex structures such as manifolds and graphs. This work establishes a rigorous theoretical analysis…

Machine Learning · Statistics 2025-02-05 Masanari Kimura , Howard Bondell

We introduce a regression model for data on non-linear manifolds. The model describes the relation between a set of manifold valued observations, such as shapes of anatomical objects, and Euclidean explanatory variables. The approach is…

Other Computer Science · Computer Science 2017-03-02 Line Kühnel , Stefan Sommer

Regression on manifolds, and, more broadly, statistics on manifolds, has garnered significant importance in recent years due to the vast number of applications for non Euclidean data. Circular data is a classic example, but so is data in…

Machine Learning · Statistics 2025-07-18 Alejandro Cholaquidis , Fabrice Gamboa , Leonardo Moreno

Existing dimensionality reduction methods are adept at revealing hidden underlying manifolds arising from high-dimensional data and thereby producing a low-dimensional representation. However, the smoothness of the manifolds produced by…

Machine Learning · Statistics 2018-07-16 Kelum Gajamannage , Randy Paffenroth , Erik M. Bollt

One of the main challenges in modern deep learning is to understand why such over-parameterized models perform so well when trained on finite data. A way to analyze this generalization concept is through the properties of the associated…

Machine Learning · Computer Science 2023-07-11 Alison Pouplin , Hrittik Roy , Sidak Pal Singh , Georgios Arvanitidis

A common belief in high-dimensional data analysis is that data are concentrated on a low-dimensional manifold. This motivates simultaneous dimension reduction and regression on manifolds. We provide an algorithm for learning gradients on…

Statistics Theory · Mathematics 2010-02-24 Sayan Mukherjee , Qiang Wu , Ding-Xuan Zhou

Manifold learning has been proven to be an effective method for capturing the implicitly intrinsic structure of non-Euclidean data, in which one of the primary challenges is how to maintain the distortion-free (isometry) of the data…

Machine Learning · Computer Science 2024-09-24 Zihao Chen , Wenyong Wang , Yu Xiang