English
Related papers

Related papers: Learning the nonlinear geometry of high-dimensiona…

200 papers

Clustering high-dimensional datasets is hard because interpoint distances become less informative in high-dimensional spaces. We present a clustering algorithm that performs nonlinear dimensionality reduction and clustering jointly. The…

Machine Learning · Computer Science 2018-03-06 Sohil Atul Shah , Vladlen Koltun

The requirement of generating predictions that exactly fulfill the fundamental symmetry of the corresponding physical quantities has profoundly shaped the development of machine-learning models for physical simulations. In many cases,…

Machine Learning · Computer Science 2026-03-27 Michelangelo Domina , Joseph William Abbott , Paolo Pegolo , Filippo Bigi , Michele Ceriotti

Learning from unordered sets is a fundamental learning setup, recently attracting increasing attention. Research in this area has focused on the case where elements of the set are represented by feature vectors, and far less emphasis has…

Machine Learning · Computer Science 2020-12-01 Haggai Maron , Or Litany , Gal Chechik , Ethan Fetaya

Several data analysis techniques employ similarity relationships between data points to uncover the intrinsic dimension and geometric structure of the underlying data-generating mechanism. In this paper we work under the model assumption…

Machine Learning · Statistics 2019-04-09 Nicolas Garcia Trillos , Daniel Sanz-Alonso , Ruiyi Yang

Autoencoding is a popular method in representation learning. Conventional autoencoders employ symmetric encoding-decoding procedures and a simple Euclidean latent space to detect hidden low-dimensional structures in an unsupervised way.…

Machine Learning · Computer Science 2024-10-07 Stefan C. Schonsheck , Scott Mahan , Timo Klock , Alexander Cloninger , Rongjie Lai

According to the Hughes phenomenon, the major challenges encountered in computations with learning models comes from the scale of complexity, e.g. the so-called curse of dimensionality. There are various approaches for accelerate learning…

Machine Learning · Computer Science 2024-10-15 Luisa D'Amore

Analyzing large volumes of high-dimensional data requires dimensionality reduction: finding meaningful low-dimensional structures hidden in their high-dimensional observations. Such practice is needed in atomistic simulations of complex…

Computational Physics · Physics 2023-10-17 Jakub Rydzewski , Ming Chen , Omar Valsson

This theoretical paper is devoted to developing a rigorous theory for demystifying the global convergence phenomenon in a challenging scenario: learning over-parameterized Rectified Linear Unit (ReLU) nets for very high dimensional dataset…

Machine Learning · Computer Science 2022-06-08 Peng He

This paper introduces an efficient multi-linear nonparametric (kernel-based) approximation framework for data regression and imputation, and its application to dynamic magnetic-resonance imaging (dMRI). Data features are assumed to reside…

Signal Processing · Electrical Eng. & Systems 2023-04-07 Duc Thien Nguyen , Konstantinos Slavakis

Point cloud data are widely used in manufacturing applications for process inspection, modeling, monitoring and optimization. The state-of-art tensor regression techniques have effectively been used for analysis of structured point cloud…

Machine Learning · Computer Science 2023-04-03 Qian Wang , Kamran Paynabar

High dimensional data analysis is known to be as a challenging problem. In this article, we give a theoretical analysis of high dimensional classification of Gaussian data which relies on a geometrical analysis of the error measure. It…

Statistics Theory · Mathematics 2008-07-10 Robin Girard

The contemporary scientific landscape is characterized by a "curse of dimensionality," where our capacity to collect high-dimensional network data frequently outstrips our ability to computationally simulate or intuitively comprehend the…

General Physics · Physics 2026-02-03 Zebiao Li , XueYing Wu , Chengyi Tu

Manifold learning offers nonlinear dimensionality reduction of high-dimensional datasets. In this paper, we bring geometry processing to bear on manifold learning by introducing a new approach based on metric connection for generating a…

Machine Learning · Computer Science 2018-11-05 Max Budninskiy , Glorian Yin , Leman Feng , Yiying Tong , Mathieu Desbrun

This paper investigates the theoretical foundations of metric learning, focused on three key questions that are not fully addressed in prior work: 1) we consider learning general low-dimensional (low-rank) metrics as well as sparse metrics;…

Machine Learning · Statistics 2018-02-07 Lalit Jain , Blake Mason , Robert Nowak

Finding best architectures of learning machines, such as deep neural networks, is a well-known technical and theoretical challenge. Recent work by Mellor et al (2021) showed that there may exist correlations between the accuracies of…

Machine Learning · Computer Science 2022-04-01 Qinghua Zhou , Alexander N. Gorban , Evgeny M. Mirkes , Jonathan Bac , Andrei Zinovyev , Ivan Y. Tyukin

Geometric deep learning has gained much attention in recent years due to more available data acquired from non-Euclidean domains. Some examples include point clouds for 3D models and wireless sensor networks in communications. Graphs are…

Signal Processing · Electrical Eng. & Systems 2022-10-04 Zhiyang Wang , Luana Ruiz , Alejandro Ribeiro

Learning the embedding space, where semantically similar objects are located close together and dissimilar objects far apart, is a cornerstone of many computer vision applications. Existing approaches usually learn a single metric in the…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Artsiom Sanakoyeu , Vadim Tschernezki , Uta Büchler , Björn Ommer

We propose a general framework for end-to-end learning of data structures. Our framework adapts to the underlying data distribution and provides fine-grained control over query and space complexity. Crucially, the data structure is learned…

Machine Learning · Computer Science 2024-11-06 Omar Salemohamed , Laurent Charlin , Shivam Garg , Vatsal Sharan , Gregory Valiant

We consider the problem of high-dimensional non-linear variable selection for supervised learning. Our approach is based on performing linear selection among exponentially many appropriately defined positive definite kernels that…

Machine Learning · Computer Science 2009-09-08 Francis Bach

Recent literature has shown that symbolic data, such as text and graphs, is often better represented by points on a curved manifold, rather than in Euclidean space. However, geometrical operations on manifolds are generally more complicated…

Machine Learning · Computer Science 2019-02-06 Max Aalto , Nakul Verma