English
Related papers

Related papers: Representation Topology Divergence: A Method for C…

200 papers

Deep neural networks (DNNs) provide useful models of visual representational transformations. We present a method that enables a DNN (student) to learn from the internal representational spaces of a reference model (teacher), which could be…

Neural and Evolutionary Computing · Computer Science 2019-09-19 Patrick McClure , Nikolaus Kriegeskorte

In topological data analysis, we want to discern topological and geometric structure of data, and to understand whether or not certain features of data are significant as opposed to simply random noise. While progress has been made on…

Computational Geometry · Computer Science 2020-01-10 So Mang Han , Taylor Okonek , Nikesh Yadav , Xiaojun Zheng

We propose a new topological tool for computer vision - Scalar Function Topology Divergence (SFTD), which measures the dissimilarity of multi-scale topology between sublevel sets of two functions having a common domain. Functions can be…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Ilya Trofimov , Daria Voronkova , Eduard Tulchinskii , Evgeny Burnaev , Serguei Barannikov

Under the banner of `Big Data', the detection and classification of structure in extremely large, high dimensional, data sets, is, one of the central statistical challenges of our times. Among the most intriguing approaches to this…

Methodology · Statistics 2022-06-08 Robert J. Adler , Sarit Agami , Pratyush Pranav

This work addresses the problem of point cloud registration using deep neural networks. We propose an approach to predict the alignment between two point clouds with overlapping data content, but displaced origins. Such point clouds…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Markus Horn , Nico Engel , Vasileios Belagiannis , Michael Buchholz , Klaus Dietmayer

Topological Data Analysis (TDA) is a novel statistical technique, particularly powerful for the analysis of large and high dimensional data sets. Much of TDA is based on the tool of persistent homology, represented visually via persistence…

Applications · Statistics 2017-11-07 Sarit Agami , Robert J. Adler

High dimensional data analysis for exploration and discovery includes three fundamental tasks: dimensionality reduction, clustering, and visualization. When the three associated tasks are done separately, as is often the case thus far,…

Machine Learning · Computer Science 2020-12-02 Stan Z. Li , Lirong Wu , Zelin Zang

Topological Data Analysis (TDA) uses insights from topology to create representations of data able to capture global and local geometric and topological properties. Its methods have successfully been used to develop estimations of fractal…

Diffusion geometry is a manifold learning framework that uses random walks defined by Markov transition matrices to characterize the geometry of a dataset at multiple scales. We use diffusion geometry for neural representations,…

Machine Learning · Computer Science 2026-05-18 Atharva Khandait , Jan E. Gerken

Neural networks encode inputs as high-dimensional vectors, known as representations, that capture how models process data by encoding task-relevant structure and semantics. Representation alignment refers to the degree to which different…

Computational Geometry · Computer Science 2026-05-26 Xinyuan Yan , Rita Sevastjanova , Mennatallah El-Assady , Bei Wang

LiDAR sensors are an integral part of modern autonomous vehicles as they provide an accurate, high-resolution 3D representation of the vehicle's surroundings. However, it is computationally difficult to make use of the ever-increasing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Marc Uecker , Tobias Fleck , Marcel Pflugfelder , J. Marius Zöllner

The topological analysis of four-dimensional (4D) image-type data is challenged by the immense size that these datasets can reach. This can render the direct application of methods, like persistent homology and convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Khalil Mathieu Hannouch , Stephan Chalup

Generative models that produce point clouds have emerged as a powerful tool to represent 3D surfaces, and the best current ones rely on learning an ensemble of parametric representations. Unfortunately, they offer no control over the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-27 Jan Bednarik , Shaifali Parashar , Erhan Gundogdu , Mathieu Salzmann , Pascal Fua

Comparing different neural network representations and determining how representations evolve over time remain challenging open questions in our understanding of the function of neural networks. Comparing representations in neural networks…

Machine Learning · Statistics 2018-10-25 Ari S. Morcos , Maithra Raghu , Samy Bengio

Topological data analysis (TDA) is a rapidly evolving field in applied mathematics and data science that leverages tools from topology to uncover robust, shape-driven insights in complex datasets. The main workhorse is persistent homology,…

History and Overview · Mathematics 2025-07-29 Zhe Su , Xiang Liu , Layal Bou Hamdan , Vasileios Maroulas , Jie Wu , Gunnar Carlsson , Guo-Wei Wei

Quantifying similarity between neural representations -- e.g. hidden layer activation vectors -- is a perennial problem in deep learning and neuroscience research. Existing methods compare deterministic responses (e.g. artificial networks…

Machine Learning · Computer Science 2023-02-07 Lyndon R. Duong , Jingyang Zhou , Josue Nassar , Jules Berman , Jeroen Olieslagers , Alex H. Williams

Computational models are quantitative representations of systems. By analyzing and comparing the outputs of such models, it is possible to gain a better understanding of the system itself. Though as the complexity of model outputs…

Machine Learning · Computer Science 2022-12-13 Colin G. Cess , Stacey D. Finley

We introduce a new deep learning method for point cloud comparison. Our approach, named Deep Point Cloud Distance (DPDist), measures the distance between the points in one cloud and the estimated surface from which the other point cloud is…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Dahlia Urbach , Yizhak Ben-Shabat , Michael Lindenbaum

Recent success in training deep neural networks have prompted active investigation into the features learned on their intermediate layers. Such research is difficult because it requires making sense of non-linear computations performed by…

Machine Learning · Computer Science 2016-03-01 Yixuan Li , Jason Yosinski , Jeff Clune , Hod Lipson , John Hopcroft

Deep learning has shown its efficacy in extracting useful features to solve various computer vision tasks. However, when the structure of the data is complex and noisy, capturing effective information to improve performance is very…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Eun Som Jeon , Rahul Khurana , Aishani Pathak , Pavan Turaga