English
Related papers

Related papers: Parameter-free Topology Inference and Sparsificati…

200 papers

A topological approach to stratification learning is developed for point cloud data drawn from a stratified space. Given such data, our objective is to infer which points belong to the same strata. First we define a multi-scale notion of a…

Geometric Topology · Mathematics 2010-08-24 Paul Bendich , Sayan Mukherjee , Bei Wang

We present the Condensate Theorem: attention sparsity is a learned topological property, not an architectural constraint. Through empirical analysis of trained language models, we find that attention mass concentrates on a distinct…

Machine Learning · Computer Science 2026-02-11 Jorge L. Ruiz Williams

Consider a set of $n$ data points in the Euclidean space $\mathbb{R}^d$. This set is called dataset in machine learning and data science. Manifold hypothesis states that the dataset lies on a low-dimensional submanifold with high…

Machine Learning · Computer Science 2022-02-04 Benyamin Ghojogh , Fakhri Karray , Mark Crowley

A central objective of topological data analysis is to identify topologically significant features in data represented as a finite point cloud. We consider the setting where the ambient space of the point sample is a compact Riemannian…

Algebraic Topology · Mathematics 2025-02-05 Ka Man Yim

Given a weighted graph $G$ and an error parameter $\epsilon > 0$, the {\em graph sparsification} problem requires sampling edges in $G$ and giving the sampled edges appropriate weights to obtain a sparse graph $G_{\epsilon}$ (containing…

Data Structures and Algorithms · Computer Science 2010-04-26 Ramesh Hariharan , Debmalya Panigrahi

We present a method for inferring dense depth maps from images and sparse depth measurements by leveraging synthetic data to learn the association of sparse point clouds with dense natural shapes, and using the image as evidence to validate…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Alex Wong , Safa Cicek , Stefano Soatto

Classical unsupervised learning methods like clustering and linear dimensionality reduction parametrize large-scale geometry when it is discrete or linear, while more modern methods from manifold learning find low dimensional representation…

Machine Learning · Computer Science 2025-09-23 Luis Scoccola , Uzu Lim , Heather A. Harrington

In part \textit{I} we proposed a structure for a general Hypotheses Space $\mathcal{H}$, the Learning Space $\mathbb{L}(\mathcal{H})$, which can be employed to avoid \textit{overfitting} when estimating in a complex space with relative…

Machine Learning · Statistics 2021-09-13 Diego Marcondes , Adilson Simonis , Junior Barrera

The hypothesis that high dimensional data tend to lie in the vicinity of a low dimensional manifold is the basis of manifold learning. The goal of this paper is to develop an algorithm (with accompanying complexity guarantees) for fitting a…

Statistics Theory · Mathematics 2013-12-23 Charles Fefferman , Sanjoy Mitter , Hariharan Narayanan

Graphlets are induced subgraph patterns and have been frequently applied to characterize the local topology structures of graphs across various domains, e.g., online social networks (OSNs) and biological networks. Discovering and computing…

Social and Information Networks · Computer Science 2016-10-19 Xiaowei Chen , Yongkun Li , Pinghui Wang , John C. S. Lui

The knowledge that data lies close to a particular submanifold of the ambient Euclidean space may be useful in a number of ways. For instance, one may want to automatically mark any point far away from the submanifold as an outlier or to…

Fitting an unknown number of hyperplanes to data is a fundamental yet challenging problem in machine learning, characterized by its non-convexity, non-differentiability, and unknown model order. Existing approaches often struggle with local…

Machine Learning · Computer Science 2026-05-28 Zhiqin Cheng , Yu Zhan , Mingjin Zhang , Lingbo Liu , Liang Lin

Topological data analysis (TDA) is a rapidly developing collection of methods for studying the shape of point cloud and other data types. One popular approach, designed to be robust to noise and outliers, is to first use a smoothing…

Methodology · Statistics 2017-12-27 Chul Moon , Noah Giansiracusa , Nicole A. Lazar

Topological descriptors, such as the Euler characteristic function and the persistence diagram, have grown increasingly popular for representing complex data. Recent work showed that a carefully chosen set of these descriptors encodes all…

Computational Geometry · Computer Science 2025-11-18 Brittany Terese Fasy , Maksym Makarchuk , Samuel Micka , David L. Millman

Let ${\mathcal M}\subset {\mathbb R}^n$ be a $C^2$-smooth compact submanifold of dimension $d$. Assume that the volume of ${\mathcal M}$ is at most $V$ and the reach (i.e. the normal injectivity radius) of ${\mathcal M}$ is greater than…

Statistics Theory · Mathematics 2022-04-19 Charles Fefferman , Sergei Ivanov , Matti Lassas , Hariharan Narayanan

Appropriately representing elements in a database so that queries may be accurately matched is a central task in information retrieval; recently, this has been achieved by embedding the graphical structure of the database into a manifold in…

Machine Learning · Statistics 2023-07-10 Yueqi Cao , Athanasios Vlontzos , Luca Schmidtke , Bernhard Kainz , Anthea Monod

A visual system has to learn both which features to extract from images and how to group locations into (proto-)objects. Those two aspects are usually dealt with separately, although predictability is discussed as a cue for both. To…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Heiko H. Schütt , Wei Ji Ma

We assume that $M_0$ is a $d$-dimensional $C^{2,1}$-smooth submanifold of $R^n$. Let $K_0$ be the convex hull of $M_0,$ and $B^n_1(0)$ be the unit ball. We assume that $ M_0 \subseteq \partial K_0 \subseteq B^n_1(0).$ We also suppose that…

Statistics Theory · Mathematics 2023-12-20 Charles Fefferman , Sergei Ivanov , Matti Lassas , Hariharan Narayanan

Inferring network topology from smooth signals is a significant problem in data science and engineering. A common challenge in real-world scenarios is the availability of only partially observed nodes. While some studies have considered…

Machine Learning · Computer Science 2025-07-08 Chuansen Peng , Hanning Tang , Zhiguo Wang , Xiaojing Shen

Parametrizations of data manifolds in shape spaces can be computed using the rich toolbox of Riemannian geometry. This, however, often comes with high computational costs, which raises the question if one can learn an efficient neural…

Machine Learning · Computer Science 2023-09-04 Josua Sassen , Klaus Hildebrandt , Martin Rumpf , Benedikt Wirth