English
Related papers

Related papers: Manifold Learning Using Kernel Density Estimation …

200 papers

Analyzing large volumes of high-dimensional data is an issue of fundamental importance in data science, molecular simulations and beyond. Several approaches work on the assumption that the important content of a dataset belongs to a…

Machine Learning · Statistics 2018-03-20 Elena Facco , Maria d'Errico , Alex Rodriguez , Alessandro Laio

The Wasserstein distance received a lot of attention recently in the community of machine learning, especially for its principled way of comparing distributions. It has found numerous applications in several hard problems, such as domain…

Machine Learning · Statistics 2017-10-23 Nicolas Courty , Rémi Flamary , Mélanie Ducoffe

Data dimensionality informs us about data complexity and sets limit on the structure of successful signal processing pipelines. In this work we revisit and improve the manifold-adaptive Farahmand-Szepesv\'ari-Audibert (FSA) dimension…

We derive non-asymptotic minimax bounds for the Hausdorff estimation of $d$-dimensional submanifolds $M \subset \mathbb{R}^D$ with (possibly) non-empty boundary $\partial M$. The model reunites and extends the most prevalent…

Statistics Theory · Mathematics 2023-03-13 Eddie Aamari , Catherine Aaron , Clément Levrard

System identification has greatly benefited from deep learning techniques, particularly for modeling complex, nonlinear dynamical systems with partially unknown physics where traditional approaches may not be feasible. However, deep…

Machine Learning · Computer Science 2025-04-17 Marco Forgione , Ankush Chakrabarty , Dario Piga , Matteo Rufolo , Alberto Bemporad

This work introduces Adaptive Density Fields (ADF), a geometric attention framework that formulates spatial aggregation as a query-conditioned, metric-induced attention operator in continuous space. By reinterpreting spatial influence as…

Machine Learning · Computer Science 2026-02-03 Zhaowen Fan

We develop a rigorous theoretical framework for principal manifold estimation that recovers a latent low-dimensional manifold from a point cloud observed in a high-dimensional ambient space. Our framework accommodates manifolds with…

Statistics Theory · Mathematics 2026-04-07 Kun Meng , Christopher Perez

In this paper we introduce and analyze the learning scenario of \emph{coupled nonlinear dimensionality reduction}, which combines two major steps of machine learning pipeline: projection onto a manifold and subsequent supervised learning.…

Machine Learning · Statistics 2015-11-26 Mehryar Mohri , Afshin Rostamizadeh , Dmitry Storcheus

Semisupervised methods inevitably invoke some assumption that links the marginal distribution of the features to the regression function of the label. Most commonly, the cluster or manifold assumptions are used which imply that the…

Statistics Theory · Mathematics 2011-12-02 Martin Azizyan , Aarti Singh , Larry Wasserman

In this paper, we present a novel two-stage metric learning algorithm. We first map each learning instance to a probability distribution by computing its similarities to a set of fixed anchor points. Then, we define the distance in the…

Machine Learning · Computer Science 2014-05-16 Jun Wang , Ke Sun , Fei Sha , Stephane Marchand-Maillet , Alexandros Kalousis

The kernel embedding algorithm is an important component for adapting kernel methods to large datasets. Since the algorithm consumes a major computation cost in the testing phase, we propose a novel teacher-learner framework of learning…

Machine Learning · Statistics 2017-12-08 Jianqiao Wangni , Jingwei Zhuo , Jun Zhu

In this paper, we propose a novel Automatic and Scalable Face Detector (ASFD), which is based on a combination of neural architecture search techniques as well as a new loss design. First, we propose an automatic feature enhance module…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Bin Zhang , Jian Li , Yabiao Wang , Ying Tai , Chengjie Wang , Jilin Li , Feiyue Huang , Yili Xia , Wenjiang Pei , Rongrong Ji

We study the machine learning task for models with operators mapping between the Wasserstein space of probability measures and a space of functions, like e.g. in mean-field games/control problems. Two classes of neural networks, based on…

Optimization and Control · Mathematics 2023-09-19 Huyên Pham , Xavier Warin

A key problem in approximation theory is the recovery of high-dimensional functions from samples. In many cases, the functions of interest exhibit anisotropic smoothness, and, in many practical settings, the nature of this anisotropy may be…

Numerical Analysis · Mathematics 2026-04-10 Ben Adcock , Avi Gupta

Low-dimensional embedding, manifold learning, clustering, classification, and anomaly detection are among the most important problems in machine learning. The existing methods usually consider the case when each instance has a fixed,…

Machine Learning · Computer Science 2012-02-20 Barnabas Poczos , Liang Xiong , Jeff Schneider

Representing images and videos with Symmetric Positive Definite (SPD) matrices and considering the Riemannian geometry of the resulting space has proven beneficial for many recognition tasks. Unfortunately, computation on the Riemannian…

Computer Vision and Pattern Recognition · Computer Science 2014-11-18 Mehrtash T. Harandi , Mathieu Salzmann , Richard Hartley

An increasing array of biomedical and computer vision applications requires the predictive modeling of complex data, for example images and shapes. The main challenge when predicting such objects lies in the fact that they do not comply to…

Machine Learning · Statistics 2017-02-17 Dimosthenis Tsagkrasoulis , Giovanni Montana

The growing volume of data produced by large astronomical surveys necessitates the development of efficient analysis techniques capable of effectively managing high-dimensional datasets. This study addresses this need by demonstrating some…

We study the recovery of geometric structure from data generated by convolving the uniform measure on a smooth compact submanifold $M\subset\mathbb{R}^D$ with ambient Gaussian noise. Our main result is that several fundamental Riemannian…

Statistics Theory · Mathematics 2026-03-31 Junhao Chen , Ruowei Li , Zhigang Yao

Data-sensitive metrics adapt distances locally based the density of data points with the goal of aligning distances and some notion of similarity. In this paper, we give the first exact algorithm for computing a data-sensitive metric called…

Computational Geometry · Computer Science 2020-04-22 Timothy Chu , Gary Miller , Donald Sheehy