English
Related papers

Related papers: Quantifying the Conceptual Error in Dimensionality…

200 papers

Quantities are distinct and critical components of texts that characterize the magnitude properties of entities, providing a precise perspective for the understanding of natural language, especially for reasoning tasks. In recent years,…

Computation and Language · Computer Science 2024-01-01 Yuncheng Huang , Qianyu He , Jiaqing Liang , Sihang Jiang , Yanghua Xiao , Yunwen Chen

This paper focuses on understanding how the generalization error scales with the amount of the training data for deep neural networks (DNNs). Existing techniques in statistical learning require computation of capacity measures, such as VC…

Machine Learning · Computer Science 2021-05-06 Devansh Bisla , Apoorva Nandini Saridena , Anna Choromanska

This paper addresses the problem of mapping high-dimensional data to a low-dimensional space, in the presence of other known features. This problem is ubiquitous in science and engineering as there are often controllable/measurable features…

Machine Learning · Statistics 2024-01-01 Anh Tuan Bui

Advances in brain-to-image reconstruction are enabling us to externalize the subjective visual experiences encoded in the brain as images. A key challenge in this task is data scarcity: a translator that maps brain activity to latent image…

Neurons and Cognition · Quantitative Biology 2026-05-08 Kenya Otsuka , Yoshihiro Nagano , Yukiyasu Kamitani

This paper investigates the theoretical foundations of metric learning, focused on three key questions that are not fully addressed in prior work: 1) we consider learning general low-dimensional (low-rank) metrics as well as sparse metrics;…

Machine Learning · Statistics 2018-02-07 Lalit Jain , Blake Mason , Robert Nowak

Dimensionality reduction is often used as an initial step in data exploration, either as preprocessing for classification or regression or for visualization. Most dimensionality reduction techniques to date are unsupervised; they do not…

Machine Learning · Statistics 2020-06-17 Jake S. Rhodes , Adele Cutler , Guy Wolf , Kevin R. Moon

The real-life data have a complex and non-linear structure due to their nature. These non-linearities and the large number of features can usually cause problems such as the empty-space phenomenon and the well-known curse of dimensionality.…

Machine Learning · Computer Science 2025-03-13 Kadir Özçoban , Murat Manguoğlu , Emrullah Fatih Yetkin

Many application areas rely on models that can be readily simulated but lack a closed-form likelihood, or an accurate approximation under arbitrary parameter values. Existing parameter estimation approaches in this setting are generally…

Methodology · Statistics 2025-08-04 Rui Zhang , Oksana A. Chkrebtii , Dongbin Xiu

Nonlinear dimensionality reduction methods are a popular tool for data scientists and researchers to visualize complex, high dimensional data. However, while these methods continue to improve and grow in number, it is often difficult to…

Machine Learning · Statistics 2019-09-04 Jonathan Johannemann , Robert Tibshirani

We present a study on how to effectively reduce the dimensions of the $k$-means clustering problem, so that provably accurate approximations are obtained. Four algorithms are presented, two \textit{feature selection} and two \textit{feature…

Machine Learning · Computer Science 2020-07-28 Neophytos Charalambides

Learned systems in the domain of visual recognition and cognition impress in part because even though they are trained with datasets many orders of magnitude smaller than the full population of possible images, they exhibit sufficient…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 John K. Tsotsos , Jun Luo

Visualizing high dimensional data by projecting them into two or three dimensional space is one of the most effective ways to intuitively understand the data's underlying characteristics, for example their class neighborhood structure.…

Machine Learning · Computer Science 2020-04-06 Pitoyo Hartono

Causal inference plays an important role in under standing the underlying mechanisation of the data generation process across various domains. It is challenging to estimate the average causal effect and individual causal effects from…

Data Structures and Algorithms · Computer Science 2023-01-05 Haoran Zhao , Yinghao Zhang , Debo Cheng , Chen Li , Zaiwen Feng

Randomized dimensionality reduction is a widely-used algorithmic technique for speeding up large-scale Euclidean optimization problems. In this paper, we study dimension reduction for a variety of maximization problems, including…

Data Structures and Algorithms · Computer Science 2025-06-03 Jie Gao , Rajesh Jayaram , Benedikt Kolbe , Shay Sapir , Chris Schwiegelshohn , Sandeep Silwal , Erik Waingarten

Having a large number of covariates can have a negative impact on the quality of causal effect estimation since confounding adjustment becomes unreliable when the number of covariates is large relative to the samples available. Propensity…

Methodology · Statistics 2020-09-15 Debo Cheng , Jiuyong Li , Lin Liu , Jixue Liu

Dimensionality reduction is a common method for analyzing and visualizing high-dimensional data. However, reasoning dynamically about the results of a dimensionality reduction is difficult. Dimensionality-reduction algorithms use complex…

Human-Computer Interaction · Computer Science 2018-11-30 Marco Cavallo , Çağatay Demiralp

In current research, machine and deep learning solutions for the classification of temporal data are shifting from single-channel datasets (univariate) to problems with multiple channels of information (multivariate). The majority of these…

Machine Learning · Computer Science 2023-04-13 Leonardos Pantiskas , Kees Verstoep , Mark Hoogendoorn , Henri Bal

Dimensionality Reduction plays a pivotal role in improving feature learning accuracy and reducing training time by eliminating redundant features, noise, and irrelevant data. Nonnegative Matrix Factorization (NMF) has emerged as a popular…

Machine Learning · Computer Science 2024-05-07 Farid Saberi-Movahed , Kamal Berahman , Razieh Sheikhpour , Yuefeng Li , Shirui Pan

Linear dimensionality reduction methods are a cornerstone of analyzing high dimensional data, due to their simple geometric interpretations and typically attractive computational properties. These methods capture many data features of…

Machine Learning · Statistics 2016-03-22 John P. Cunningham , Zoubin Ghahramani

Digital Transformation (DT) initiatives frequently face high failure rates, and while Digital Maturity Models (DMMs) offer potential solutions, they have notable shortcomings. Specifically, there is significant disparity in the dimensions…

Software Engineering · Computer Science 2026-02-10 Eduardo C. Peixoto , Hector Oliveira , Geber L. Ramalho , Cesar França