English
Related papers

Related papers: Measuring Dataset Diversity from a Geometric Persp…

200 papers

The curse of dimensionality is a phenomenon frequently observed in machine learning (ML) and knowledge discovery (KD). There is a large body of literature investigating its origin and impact, using methods from mathematics as well as from…

Artificial Intelligence · Computer Science 2022-04-22 Tom Hanika , Friedrich Martin Schneider , Gerd Stumme

Topological Data Analysis (TDA) is an emergent field that aims to discover topological information hidden in a dataset. TDA tools have been commonly used to create filters and topological descriptors to improve Machine Learning (ML)…

Machine Learning · Computer Science 2022-02-07 Rolando Kindelan , José Frías , Mauricio Cerda , Nancy Hitschfeld

Data diversity is crucial for the instruction tuning of large language models. Existing studies have explored various diversity-aware data selection methods to construct high-quality datasets and enhance model performance. However, the…

Computation and Language · Computer Science 2025-06-03 Yuming Yang , Yang Nan , Junjie Ye , Shihan Dou , Xiao Wang , Shuo Li , Huijie Lv , Mingqi Wu , Tao Gui , Qi Zhang , Xuanjing Huang

In this paper, we introduce two robust, nonparametric methods for multiple change-point detection in the variability of a multivariate sequence of observations. We demonstrate that changes in ranks generated from data depth functions can be…

Methodology · Statistics 2021-11-30 Kelly Ramsay , Shoja'eddin Chenouri

Diversity is an important consideration in the construction of robust neural network ensembles. A collection of well trained models will generalize better if they are diverse in the patterns they respond to and the predictions they make.…

Machine Learning · Computer Science 2023-02-14 Tim Whitaker , Darrell Whitley

A primary hypothesis that drives scientific and engineering studies is that data has structure. The dominant paradigms for describing such structure are statistics (e.g., moments, correlation functions) and signal processing (e.g.,…

Algebraic Topology · Mathematics 2020-11-11 Alexander D. Smith , Pawel Dlotko , Victor M. Zavala

Past research relates design creativity to 'divergent thinking,' i.e., how well the concept space is explored during the early phase of design. Researchers have argued that generating several concepts would increase the chances of producing…

Computation and Language · Computer Science 2024-08-02 Anubhab Majumder , Ujjwal Pal , Amaresh Chakrabarti

This paper concerns a theoretical approach that combines topological data analysis (TDA) and sheaf theory. Topological data analysis, a rising field in mathematics and computer science, concerns the shape of the data and has been proven…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Chuan-Shen Hu , Yu-Min Chung

Topological Data Analysis (TDA) is a rapidly growing field, which studies methods for learning underlying topological structures present in complex data representations. TDA methods have found recent success in extracting useful geometric…

Methodology · Statistics 2021-03-09 Xiaojun Zheng , Simon Mak , Yao Xie

Data valuation, especially quantifying data value in algorithmic prediction and decision-making, is a fundamental problem in data trading scenarios. The most widely used method is to define the data Shapley and approximate it by means of…

Machine Learning · Statistics 2023-05-23 Mengmeng Wu , Ruoxi Jia , Changle Lin , Wei Huang , Xiangyu Chang

Topological data analysis (TDA) aims to extract noise-robust features from a data set by examining the number and persistence of holes in its topology. We show that a computational problem closely related to a core task in TDA --…

Quantum Physics · Physics 2024-10-29 Casper Gyurik , Alexander Schmidhuber , Robbie King , Vedran Dunjko , Ryu Hayakawa

Recently, there has been an explosion in statistical learning literature to represent data using topological principles to capture structure and relationships. We propose a topological data analysis (TDA)-based framework, named Topological…

Machine Learning · Statistics 2025-11-10 Jordan Eckert , Elvan Ceyhan , Henry Schenck

Diverse planning approaches are utilised in real-world applications like risk management, automated streamed data analysis, and malware detection. The current diverse planning formulations encode the diversity model as a distance function,…

Artificial Intelligence · Computer Science 2025-06-23 Mustafa F Abdelwahed , Joan Espasa , Alice Toniolo , Ian P. Gent

Understanding the response of an output variable to multi-dimensional inputs lies at the heart of many data exploration endeavours. Topology-based methods, in particular Morse theory and persistent homology, provide a useful framework for…

Graphics · Computer Science 2022-08-16 Yarden Livnat , Dan Maljovec , Attila Gyulassy , Dr Baptiste Mouginot , Valerio Pascucci

Dimensionality reduction algorithms map high-dimensional data into visualizable 2D or 3D spaces, but traditionally rely on a discrete point-cloud paradigm. This discrete abstraction is susceptible to visual occlusion and artificial…

Graphics · Computer Science 2026-05-19 João Paulo Gois , Luis Gustavo Nonato

When constructing a classifier ensemble, diversity among the base classifiers is one of the important characteristics. Several studies have been made in the context of standard static data, in particular, when analyzing the relationship…

Machine Learning · Computer Science 2019-02-25 Mohamed Souhayel Abassi

Large data-driven image models are extensively used to support creative and artistic work. Under the currently predominant distribution-fitting paradigm, a dataset is treated as ground truth to be approximated as closely as possible. Yet,…

Machine Learning · Computer Science 2023-06-16 Sebastian Berns , Simon Colton , Christian Guckelsberger

Topological data analysis is becoming a popular way to study high dimensional feature spaces without any contextual clues or assumptions. This paper concerns itself with one popular topological feature, which is the number of…

Algebraic Topology · Mathematics 2016-05-31 Rushil Anirudh , Vinay Venkataraman , Karthikeyan Natesan Ramamurthy , Pavan Turaga

Quantifying the distance between datasets is a fundamental question in mathematics and machine learning. We propose \textit{magnitude distance}, a novel distance metric defined on finite datasets using the notion of the \emph{magnitude} of…

Machine Learning · Computer Science 2026-02-10 Sahel Torkamani , Henry Gouk , Rik Sarkar

Symmetry plays a fundamental role in understanding natural phenomena and mathematical structures. This work develops a comprehensive theory for studying the persistent symmetries and degree of asymmetry of finite point configurations over…

Algebraic Topology · Mathematics 2025-08-12 Jian Liu , Dong Chen , Guo-Wei Wei