English
Related papers

Related papers: Interpretable dimension reduction for compositiona…

200 papers

Differential abundance analysis is at the core of statistical analysis of microbiome data. The compositional nature of microbiome sequencing data makes false positive control challenging. Here, we show that the compositional effects can be…

Methodology · Statistics 2022-03-15 Huijuan Zhou , Kejun He , Jun Chen , Xianyang Zhang

We propose a novel and computationally efficient approach for nonparametric conditional density estimation in high-dimensional settings that achieves dimension reduction without imposing restrictive distributional or functional form…

Econometrics · Economics 2025-10-14 Jianhua Mei , Fu Ouyang , Thomas T. Yang

Dimensionality reduction (DR) is one of the key tools for the visual exploration of high-dimensional data and uncovering its cluster structure in two- or three-dimensional spaces. The vast majority of DR methods in the literature do not…

Machine Learning · Computer Science 2026-04-28 Stavros Gerolymatos , Xenophon Evangelopoulos , Vladimir Gusev , John Y. Goulermas

To cluster, classify and represent are three fundamental objectives of learning from high-dimensional data with intrinsic structure. To this end, this paper introduces three interpretable approaches, i.e., segmentation (clustering) via the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Kai-Liang Lu , Avraham Chapman

Identifying low-dimensional sufficient structures in nonlinear sufficient dimension reduction (SDR) has long been a fundamental yet challenging problem. Most existing methods lack theoretical guarantees of exhaustiveness in identifying…

Machine Learning · Statistics 2025-12-23 Shuntuo Xu , Zhou Yu , Jian Huang

Mechanistic interpretability aims to explain neural model behaviour by reverse-engineering learned computational structure into human-understandable components. Without a formal framework, however, mechanistic explanations cannot be…

Machine Learning · Computer Science 2026-05-12 Ward Gauderis , Thomas Dooms , Steven T. Holmer , Kola Ayonrinde , Geraint A. Wiggins

This paper introduces a novel framework for dynamic classification in high dimensional spaces, addressing the evolving nature of class distributions over time or other index variables. Traditional discriminant analysis techniques are…

Methodology · Statistics 2025-02-18 Wenbo Ouyang , Ruiyang Wu , Ning Hao , Hao Helen Zhang

A method for dimension reduction with clustering, classification, or discriminant analysis is introduced. This mixture model-based approach is based on fitting generalized hyperbolic mixtures on a reduced subspace within the paradigm of…

Methodology · Statistics 2017-10-09 Katherine Morris , Paul D. McNicholas

Contrastive dimension reduction (CDR) methods aim to extract signal unique to or enriched in a treatment (foreground) group relative to a control (background) group. This setting arises in many scientific domains, such as genomics, imaging,…

Methodology · Statistics 2025-10-15 Sam Hawke , Eric Zhang , Jiawen Chen , Didong Li

We propose a method to reconstruct and cluster incomplete high-dimensional data lying in a union of low-dimensional subspaces. Exploring the sparse representation model, we jointly estimate the missing data while imposing the intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 João Carvalho , Manuel Marques , João P. Costeira

This paper proposes a data-adaptive factor model (DAFM), a novel framework for extracting common factors that explain the structures of high-dimensional data. DAFM adopts a composite quantile strategy to adaptively capture the full…

Methodology · Statistics 2025-10-02 Seeun Park , Hee-Seok Oh

In this paper we apply the previously introduced approximation method based on the ANOVA (analysis of variance) decomposition and Grouped Transformations to synthetic and real data. The advantage of this method is the interpretability of…

Machine Learning · Statistics 2022-01-31 Daniel Potts , Michael Schmischke

Compositional data, which are vectors of proportions constrained to the probability simplex, arise frequently in modern scientific applications, including microbiome relative abundances across body sites and cell-type mixture weights…

Methodology · Statistics 2026-05-08 Shuangjie Zhang , Bani K. Mallick , Yang Ni

Dimension reduction (DR) is inherently non-unique: multiple embeddings can preserve the structure of high-dimensional data equally well while differing in layout or geometry. In this paper, we formally define the Rashomon set for DR -- the…

Machine Learning · Computer Science 2026-04-29 Yiyang Sun , Haiyang Huang , Gaurav Rajesh Parikh , Cynthia Rudin

As organizations face the challenges of processing exponentially growing data volumes, their reliance on analytics to unlock value from this data has intensified. However, the intricacies of big data, such as its extensive feature sets,…

Human-Computer Interaction · Computer Science 2024-05-14 Joshua Holstein , Philipp Spitzer , Marieke Hoell , Michael Vössing , Niklas Kühl

Data visualization and dimension reduction for regression between a general metric space-valued response and Euclidean predictors is proposed. Current Fr\'ech\'et dimension reduction methods require that the response metric space be…

Methodology · Statistics 2024-05-28 Abdul-Nasah Soale , Yuexiao Dong

Scientific computations or measurements may result in huge volumes of data. Often these can be thought of representing a real-valued function on a high-dimensional domain, and can be conceptually arranged in the format of a tensor of high…

Numerical Analysis · Mathematics 2019-09-24 Mike Espig , Wolfgang Hackbusch , Alexander Litvinenko , Hermann G. Matthies , Elmar Zander

Microbial communities analysis is drawing growing attention due to the rapid development of high-throughput sequencing techniques nowadays. The observed data has the following typical characteristics: it is high-dimensional, compositional…

Methodology · Statistics 2020-04-30 Yong He , Pengfei Liu , Xinsheng Zhang , Wang Zhou

Interpretable scientific machine learning often trades predictive performance for structural transparency. When physical targets arise from hierarchical and nonlinear descriptor entanglement, weakly interacting white-box models underfit,…

Materials Science · Physics 2026-03-30 Seong-Hoon Jang

We investigate the task of retrieving information from compositional distributed representations formed by Hyperdimensional Computing/Vector Symbolic Architectures and present novel techniques which achieve new information rate bounds.…

Neural and Evolutionary Computing · Computer Science 2023-05-29 Denis Kleyko , Connor Bybee , Ping-Chen Huang , Christopher J. Kymn , Bruno A. Olshausen , E. Paxon Frady , Friedrich T. Sommer