English
Related papers

Related papers: Quantifying the Conceptual Error in Dimensionality…

200 papers

Real-world datasets are often of high dimension and effected by the curse of dimensionality. This hinders their comprehensibility and interpretability. To reduce the complexity feature selection aims to identify features that are crucial to…

Machine Learning · Computer Science 2023-04-18 Maximilian Stubbemann , Tobias Hille , Tom Hanika

Recently, detection of label errors and improvement of label quality in datasets for supervised learning tasks has become an increasingly important goal in both research and industry. The consequences of incorrectly annotated data include…

Machine Learning · Computer Science 2025-08-26 Sarina Penquitt , Tobias Riedlinger , Timo Heller , Markus Reischl , Matthias Rottmann

We propose a class of dimension reduction methods for right censored survival data using a counting process representation of the failure process. Semiparametric estimating equations are constructed to estimate the dimension reduction…

Methodology · Statistics 2018-06-11 Qiang Sun , Ruoqing Zhu , Tao Wang , Donglin Zeng

We show how to approximate a data matrix $\mathbf{A}$ with a much smaller sketch $\mathbf{\tilde A}$ that can be used to solve a general class of constrained k-rank approximation problems to within $(1+\epsilon)$ error. Importantly, this…

Data Structures and Algorithms · Computer Science 2015-04-06 Michael B. Cohen , Sam Elder , Cameron Musco , Christopher Musco , Madalina Persu

Dimensionality reduction is a fundamental task in modern data science. Several projection methods specifically tailored to take into account the non-linearity of the data via local embeddings have been proposed. Such methods are often based…

Machine Learning · Statistics 2026-01-28 Antonio Di Noia , Federico Ravenda , Antonietta Mira

Given the variety of the visual world there is not one true scale for recognition: objects may appear at drastically different sizes across the visual field. Rather than enumerate variations across filter channels or pyramid levels, dynamic…

Computer Vision and Pattern Recognition · Computer Science 2019-08-09 Dequan Wang , Evan Shelhamer , Bruno Olshausen , Trevor Darrell

Ensuring data quality at scale remains a persistent challenge for large organizations. Despite recent advances, maintaining accurate and consistent data is still complex, especially when dealing with multiple data modalities. Traditional…

Machine Learning · Computer Science 2025-10-15 Olga Ovcharenko , Sebastian Schelter

Machine learning (ML) datasets, often perceived as neutral, inherently encapsulate abstract and disputed social constructs. Dataset curators frequently employ value-laden terms such as diversity, bias, and quality to characterize datasets.…

Machine Learning · Computer Science 2024-07-12 Dora Zhao , Jerone T. A. Andrews , Orestis Papakyriakopoulos , Alice Xiang

Measuring dataset similarity is fundamental in machine learning, particularly for transfer learning and domain adaptation. In the context of supervised learning, most existing approaches quantify similarity of two data sets based on their…

Machine Learning · Statistics 2026-04-22 Shudong Sun , Hao Helen Zhang , Joseph C Watkins

Recent work has explored reduced numerical precision for parameters, activations, and gradients during neural network training as a way to reduce the computational cost of training (Na & Mukhopadhyay, 2016) (Courbariaux et al., 2014). We…

Machine Learning · Computer Science 2019-01-25 Ian Taras , Dylan Malone Stuart

We propose a novel probabilistic dimensionality reduction framework that can naturally integrate the generative model and the locality information of data. Based on this framework, we present a new model, which is able to learn a smooth…

Machine Learning · Statistics 2016-10-18 Li Wang

One of the fundamental problems within the field of machine learning is dimensionality reduction. Dimensionality reduction methods make it possible to combat the so-called curse of dimensionality, visualize high-dimensional data and, in…

Machine Learning · Computer Science 2025-05-12 Sergio García-Heredia , Ángela Fernández , Carlos M. Alaíz

Dimensionality reduction represents the process of generating a low dimensional representation of high dimensional data. Motivated by the formation control of mobile agents, we propose a nonlinear dynamical system for dimensionality…

Machine Learning · Computer Science 2025-01-17 Taeuk Jeong , Yoon Mo Jung , Euntack Lee

We show how clustering standard errors in one or more dimensions can be justified in M-estimation when there is sampling or assignment uncertainty. Since existing procedures for variance estimation are either conservative or invalid, we…

Econometrics · Economics 2024-11-21 Ruonan Xu , Luther Yap

Categorical data does not have an intrinsic definition of distance or order, and therefore, established visualization techniques for categorical data only allow for a set-based or frequency-based analysis, e.g., through Euler diagrams or…

Human-Computer Interaction · Computer Science 2025-01-15 Frederik L. Dennig , Lucas Joos , Patrick Paetzold , Daniela Blumberg , Oliver Deussen , Daniel A. Keim , Maximilian T. Fischer

Machine unlearning seeks to remove the influence of specified data from a trained model. While the unlearning accuracy provides a widely used metric for assessing unlearning performance, it falls short in assessing the reliability of…

Machine Learning · Computer Science 2026-05-13 Yingdan Shi , Sijia Liu , Kaize Ding , Ren Wang

Recent advancements in reasoning language models have demonstrated remarkable performance in complex tasks, but their extended chain-of-thought reasoning process increases inference overhead. While quantization has been widely adopted to…

Computation and Language · Computer Science 2025-08-19 Ruikang Liu , Yuxuan Sun , Manyi Zhang , Haoli Bai , Xianzhi Yu , Tiezheng Yu , Chun Yuan , Lu Hou

This paper addresses the challenge of integrating sequentially arriving data within the quantile regression framework, where the number of features is allowed to grow with the number of observations, the horizon is unknown, and memory is…

Statistics Theory · Mathematics 2025-10-21 Yinan Shen , Dong Xia , Wen-Xin Zhou

Topic models are a class of unsupervised learning algorithms for detecting the semantic structure within a text corpus. Together with a subsequent dimensionality reduction algorithm, topic models can be used for deriving spatializations for…

Computation and Language · Computer Science 2023-10-26 Daniel Atzberger , Tim Cech , Willy Scheibel , Matthias Trapp , Rico Richter , Jürgen Döllner , Tobias Schreck

Whereas most dimensionality reduction techniques (e.g. PCA, ICA, NMF) for multivariate data essentially rely on linear algebra to a certain extent, summarizing ranking data, viewed as realizations of a random permutation $\Sigma$ on a set…

Machine Learning · Statistics 2019-09-02 Mastane Achab , Anna Korba , Stephan Clémençon