English
Related papers

Related papers: Intrinsic Dimension for Large-Scale Geometric Lear…

200 papers

Modern datasets are characterized by a large number of features that may conceal complex dependency structures. To deal with this type of data, dimensionality reduction techniques are essential. Numerous dimensionality reduction methods…

Methodology · Statistics 2021-06-02 Francesco Denti , Diego Doimo , Alessandro Laio , Antonietta Mira

Building fair deep neural networks (DNNs) is a crucial step towards achieving trustworthy artificial intelligence. Delving into deeper factors that affect the fairness of DNNs is paramount and serves as the foundation for mitigating model…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Yanbiao Ma , Licheng Jiao , Fang Liu , Lingling Li , Wenping Ma , Shuyuan Yang , Xu Liu , Puhua Chen

Accurate approximation of a real-valued function depends on two aspects of the available data: the density of inputs within the domain of interest and the variation of the outputs over that domain. There are few methods for assessing…

Numerical Analysis · Mathematics 2024-11-11 Andrew Gillette , Eugene Kur

Machine learning models can generalize well on real-world datasets. According to the manifold hypothesis, this is possible because datasets lie on a latent manifold with small intrinsic dimension (ID). There exist many methods for ID…

Machine Learning · Computer Science 2025-10-03 Aritra Das , Joseph T. Iosue , Victor V. Albert

The goal of this thesis is to improve our understanding of the internal mechanisms by which deep artificial neural networks create meaningful representations and are able to generalize. We focus on the challenge of characterizing the…

Machine Learning · Computer Science 2025-10-29 Diego Doimo

Imbalance in classification tasks is commonly quantified by the cardinalities of examples across classes. This, however, disregards the presence of redundant examples and inherent differences in the learning difficulties of classes.…

Machine Learning · Computer Science 2026-01-22 Çağrı Eser , Zeynep Sonat Baltacı , Emre Akbaş , Sinan Kalkan

Molecular dynamics (MD) simulations provide atomistic insights into the structure, dynamics, and function of biomolecules by generating time-resolved, high-dimensional trajectories. Analyzing such data benefits from estimating the minimal…

Biomolecules · Quantitative Biology 2026-03-02 Irene Cazzaniga , Toni Giorgino

This paper addresses the following questions pertaining to the intrinsic dimensionality of any given image representation: (i) estimate its intrinsic dimensionality, (ii) develop a deep neural network based non-linear mapping, dubbed…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Sixue Gong , Vishnu Naresh Boddeti , Anil K. Jain

In the last decades the estimation of the intrinsic dimensionality of a dataset has gained considerable importance. Despite the great deal of research work devoted to this task, most of the proposed solutions prove to be unreliable when the…

Machine Learning · Computer Science 2012-06-19 Claudio Ceruti , Simone Bassis , Alessandro Rozza , Gabriele Lombardi , Elena Casiraghi , Paola Campadelli

Quantifying the distance between datasets is a fundamental question in mathematics and machine learning. We propose \textit{magnitude distance}, a novel distance metric defined on finite datasets using the notion of the \emph{magnitude} of…

Machine Learning · Computer Science 2026-02-10 Sahel Torkamani , Henry Gouk , Rik Sarkar

The last decade has witnessed an experimental revolution in data science and machine learning, epitomised by deep learning methods. Indeed, many high-dimensional learning tasks previously thought to be beyond reach -- such as computer…

Machine Learning · Computer Science 2021-05-04 Michael M. Bronstein , Joan Bruna , Taco Cohen , Petar Veličković

Intrinsic image decomposition aims to estimate physically based rendering (PBR) parameters such as albedo, roughness, and metallicity from images. While recent methods achieve strong single-view predictions, applying them independently to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Alara Dirik , Stefanos Zafeiriou

Several machine learning models are defined for inputs of any size, such as graphs with different numbers of nodes and point clouds containing varying numbers of points. The universality properties of such any-dimensional models remain…

Machine Learning · Computer Science 2026-05-25 Shengtai Yao , Eitan Levin , Mateo Díaz

Datasets such as images, text, or movies are embedded in high-dimensional spaces. However, in important cases such as images of objects, the statistical structure in the data constrains samples to a manifold of dramatically lower…

Machine Learning · Computer Science 2019-10-29 Stefano Recanatesi , Matthew Farrell , Madhu Advani , Timothy Moore , Guillaume Lajoie , Eric Shea-Brown

It has long been noticed that high dimension data exhibits strange patterns. This has been variously interpreted as either a "blessing" or a "curse", causing uncomfortable inconsistencies in the literature. We propose that these patterns…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Wen-Yan Lin

Recent work has found that neural networks with stronger generalization tend to exhibit higher representational alignment with one another across architectures and training paradigms. In this work, we show that models with stronger…

Machine Learning · Computer Science 2026-02-02 Junjie Yu , Wenxiao Ma , Chen Wei , Jianyu Zhang , Haotian Deng , Zihan Deng , Quanying Liu

In many high-impact applications, it is important to ensure the quality of output of a machine learning algorithm as well as its reliability in comparison with the complexity of the algorithm used. In this paper, we have initiated a…

Machine Learning · Computer Science 2023-03-03 Katarina Doctor , Tong Mao , Hrushikesh Mhaskar

A method for extracting multiscale geometric features from a data cloud is proposed and analyzed. The basic idea is to map each pair of data points into a real-valued feature function defined on $[0,1]$. The construction of these feature…

Statistics Theory · Mathematics 2019-12-16 Gabriel Chandler , Wolfgang Polonik

The amount of information available in spectro-polarimetric data is estimated. To this end, the intrinsic dimensionality of the data is inferred with the aid of a recently derived estimator based on nearest-neighbor considerations and…

In machine learning, the performance of a classifier depends on both the classifier model and the separability/complexity of datasets. To quantitatively measure the separability of datasets, we create an intrinsic measure -- the…

Machine Learning · Computer Science 2021-09-14 Shuyue Guan , Murray Loew