English
Related papers

Related papers: Trustworthy Dimensionality Reduction

200 papers

Unsupervised machine learning has recently gained much attention in the field of molecular dynamics (MD). Particularly, dimensionality reduction techniques have been regularly employed to analyze large volumes of high-dimensional MD data to…

Chemical Physics · Physics 2025-05-23 Patryk Tajs , Mateusz Skarupski , Jakub Rydzewski

Dimension Estimation (DE) and Dimension Reduction (DR) are two closely related topics, but with quite different goals. In DE, one attempts to estimate the intrinsic dimensionality or number of latent variables in a set of measurements of a…

Machine Learning · Computer Science 2019-09-25 Nitish Bahadur , Randy Paffenroth

Large Language Model-based Dense Retrieval (LLM-DR) optimizes over numerous heterogeneous fine-tuning collections from different domains. However, the discussion about its training data distribution is still minimal. Previous studies rely…

Information Retrieval · Computer Science 2025-05-14 Guangyuan Ma , Yongliang Ma , Xing Wu , Zhenpeng Su , Ming Zhou , Songlin Hu

This paper presents a unified framework for sufficient dimension reduction (SDR) that generalizes several existing SDR techniques and offers new insights into the connection between inverse conditional moment independence and dimension…

Methodology · Statistics 2026-05-11 Jicai Liu , Yu Zhang , Jinhong Li

Standard Adjacency Spectral Embedding (ASE) relies on a global low-rank assumption often incompatible with the sparse, transitive structure of real-world networks, causing local geometric features to be 'smeared'. To address this, we…

Machine Learning · Statistics 2026-03-13 Hannah Sansford , Nick Whiteley , Patrick Rubin-Delanchy

Due to the intrinsic complexity of high-dimensional (HD) data, dimensionality reduction (DR) techniques cannot preserve all the structural characteristics of the original data. Therefore, DR techniques focus on preserving either local…

Machine Learning · Computer Science 2025-11-18 Hyeon Jeon , Kwon Ko , Soohyun Lee , Jake Hyun , Taehyun Yang , Gyehun Go , Jaemin Jo , Jinwook Seo

Recent advances in machine learning allow us to analyze and describe the content of high-dimensional data like text, audio, images or other signals. In order to visualize that data in 2D or 3D, usually Dimensionality Reduction (DR)…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Dimitris Spathis , Nikolaos Passalis , Anastasios Tefas

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

Machine Learning · Computer Science 2016-06-13 Furong Huang

Multidimensional Scaling (MDS) is one of the most popular methods for dimensionality reduction and visualization of high dimensional data. Apart from these tasks, it also found applications in the field of geometry processing for the…

Computational Geometry · Computer Science 2017-09-12 Amit Boyarski , Alex M. Bronstein , Michael M. Bronstein

Despite significant advances in deep learning, models often struggle to generalize well to new, unseen domains, especially when training data is limited. To address this challenge, we propose a novel approach for distribution-aware latent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Ran Liu , Sahil Khose , Jingyun Xiao , Lakshmi Sathidevi , Keerthan Ramnath , Zsolt Kira , Eva L. Dyer

Low-dimensional embeddings (LDEs) of high-dimensional data are ubiquitous in science and engineering. They allow us to quickly understand the main properties of the data, identify outliers and processing errors, and inform the next steps of…

Machine Learning · Computer Science 2024-06-17 Jonas Fischer , Rong Ma

In this paper, we consider the problem of non-linear dimensionality reduction under uncertainty, both from a theoretical and algorithmic perspectives. Since real-world data usually contain measurements with uncertainties and artifacts, the…

Machine Learning · Computer Science 2022-02-11 Firas Laakom , Jenni Raitoharju , Nikolaos Passalis , Alexandros Iosifidis , Moncef Gabbouj

We introduce a novel sufficient dimension-reduction (SDR) method which is robust against outliers using $\alpha$-distance covariance (dCov) in dimension-reduction problems. Under very mild conditions on the predictors, the central subspace…

Methodology · Statistics 2024-02-06 Hsin-Hsiung Huang , Feng Yu , Teng Zhang

Dimensionality reduction (DR) plays a vital role in the visual analysis of high-dimensional data. One main aim of DR is to reveal hidden patterns that lie on intrinsic low-dimensional manifolds. However, DR often overlooks important…

Machine Learning · Computer Science 2023-02-28 Takanori Fujiwara , Yun-Hsin Kuo , Anders Ynnerman , Kwan-Liu Ma

Dimensionality reduction is a critical step in scaling machine learning pipelines. Principal component analysis (PCA) is a standard tool for dimensionality reduction, but performing PCA over a full dataset can be prohibitively expensive. As…

Databases · Computer Science 2020-08-25 Sahaana Suri , Peter Bailis

Feature representation is an important aspect of remote-sensing based image classification. While deep convolutional neural networks are able to effectively amalgamate information, large numbers of parameters often make learned features…

Machine Learning · Computer Science 2022-03-07 Joshua Peeples , Sarah Walker , Connor McCurley , Alina Zare , James Keller , Weihuang Xu

Learning representations that capture both intrinsic data geometry and target-relevant structure remains a fundamental challenge, particularly in settings where data reduction must balance compression with predictive fidelity. While…

Machine Learning · Computer Science 2026-05-28 Sai-Aakash Ramesh , Archit Sood , Andrew Corbett , Tim Dodwell

Non-linear dimensionality reduction (NLDR) methods such as t-distributed stochastic neighbour embedding (t-SNE) are ubiquitous in the natural sciences, however, the appropriate use of these methods is difficult because of their complex…

Other Statistics · Statistics 2020-12-14 Stuart Lee , Ursula Laa , Dianne Cook

We present a framework for supervised subspace tracking, when there are two time series $x_t$ and $y_t$, one being the high-dimensional predictors and the other being the response variables and the subspace tracking needs to take into…

Machine Learning · Computer Science 2015-09-02 Yao Xie , Ruiyang Song , Hanjun Dai , Qingbin Li , Le Song

This paper presents an overview and comparative study of the state of the art in State-Order Reduction (SOR) and Scheduling Dimension Reduction (SDR) for Linear Parameter-Varying (LPV) State-Space (SS) models, comparing and benchmarking…

Systems and Control · Electrical Eng. & Systems 2024-04-03 E. Javier Olucha , Bogoljub Terzin , Amritam Das , Roland Tóth