English
Related papers

Related papers: Principal Decomposition with Nested Submanifolds

200 papers

The dynamic mode decomposition (DMD) is a data-driven method used for identifying the dynamics of complex nonlinear systems. It extracts important characteristics of the underlying dynamics using measured time-domain data produced either by…

Numerical Analysis · Mathematics 2020-11-24 Ion Victor Gosea , Igor Pontes Duff

The ability to extract generative parameters from high-dimensional fields of data in an unsupervised manner is a highly desirable yet unrealized goal in computational physics. This work explores the use of variational autoencoders (VAEs)…

Computational Physics · Physics 2021-11-16 Christian Jacobsen , Karthik Duraisamy

We present a novel, domain-agnostic, model-independent, unsupervised, and universally applicable Machine Learning approach for dimensionality reduction based on the principles of algorithmic complexity. Specifically, but without loss of…

Data Structures and Algorithms · Computer Science 2025-05-06 Hector Zenil , Narsis A. Kiani , Alyssa Adams , Felipe S. Abrahão , Antonio Rueda-Toicen , Allan A. Zea , Luan Ozelim , Jesper Tegnér

Suppose we observe data of the form $Y_i = D_i (S_i + \varepsilon_i) \in \mathbb{R}^p$ or $Y_i = D_i S_i + \varepsilon_i \in \mathbb{R}^p$, $i=1,\ldots,n$, where $D_i \in \mathbb{R}^{p\times p}$ are known diagonal matrices, $\varepsilon_i$…

Statistics Theory · Mathematics 2018-11-05 Edgar Dobriban , William Leeb , Amit Singer

Disentangling complex data to its latent factors of variation is a fundamental task in representation learning. Existing work on sequential disentanglement mostly provides two factor representations, i.e., it separates the data to…

Machine Learning · Computer Science 2023-03-31 Nimrod Berman , Ilan Naiman , Omri Azencot

Learning disentangled representations of data is a fundamental problem in artificial intelligence. Specifically, disentangled latent representations allow generative models to control and compose the disentangled factors in the synthesis…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Yotam Nitzan , Amit Bermano , Yangyan Li , Daniel Cohen-Or

Personalized treatment of patients based on tissue-specific cancer subtypes has strongly increased the efficacy of the chosen therapies. Even though the amount of data measured for cancer patients has increased over the last years, most…

Machine Learning · Statistics 2017-09-18 Nora K. Speicher , Nico Pfeifer

One aim of dimensionality reduction is to discover the main factors that explain the data, and as such is paramount to many applications. When working with high dimensional data, autoencoders offer a simple yet effective approach to learn…

Machine Learning · Computer Science 2025-08-29 Benjamin Couéraud , Vikram Sunkara , Christof Schütte

A new dimension reduction (DR) method for data sets is proposed by autonomous deforming of data manifolds. The deformation is guided by the proposed deforming vector field, which is defined by two kinds of virtual interactions between data…

Machine Learning · Computer Science 2021-10-22 Xiaodong Zhuang

We propose a new embedding method which is particularly well-suited for settings where the sample size greatly exceeds the ambient dimension. Our technique consists of partitioning the space into simplices and then embedding the data points…

Machine Learning · Computer Science 2020-02-07 Lee-Ad Gottlieb , Eran Kaufman , Aryeh Kontorovich , Gabriel Nivasch , Ofir Pele

Spatially localized deformation components are very useful for shape analysis and synthesis in 3D geometry processing. Several methods have recently been developed, with an aim to extract intuitive and interpretable deformation components.…

Graphics · Computer Science 2017-12-19 Qingyang Tan , Lin Gao , Yu-Kun Lai , Jie Yang , Shihong Xia

We propose a framework of principal manifolds to model high-dimensional data. This framework is based on Sobolev spaces and designed to model data of any intrinsic dimension. It includes principal component analysis and principal curve…

Methodology · Statistics 2021-03-30 Kun Meng , Ani Eloyan

In recent years, deep learning-based image compression, particularly through generative models, has emerged as a pivotal area of research. Despite significant advancements, challenges such as diminished sharpness and quality in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Ryugo Morita , Hitoshi Nishimura , Ko Watanabe , Andreas Dengel , Jinjia Zhou

Dimensionality reduction is critical across various domains of science including neuroscience. Probabilistic Principal Component Analysis (PPCA) is a prominent dimensionality reduction method that provides a probabilistic approach unlike…

Machine Learning · Computer Science 2025-09-24 Han-Lin Hsieh , Maryam M. Shanechi

We provide a probabilistic and infinitesimal view of how the principal component analysis procedure (PCA) can be generalized to analysis of nonlinear manifold valued data. Starting with the probabilistic PCA interpretation of the Euclidean…

Statistics Theory · Mathematics 2018-06-26 Stefan Sommer

We consider the problem of developing interpretable and computationally efficient matrix decomposition methods for matrices whose entries have bounded support. Such matrices are found in large-scale DNA methylation studies and many other…

Machine Learning · Computer Science 2024-10-25 Anjali N. Albert , Patrick Flaherty , Aaron Schein

Learning efficient representations of local features is a key challenge in feature volume-based 3D neural mapping, especially in large-scale environments. In this paper, we introduce Decomposition-based Neural Mapping (DNMap), a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Minseong Park , Suhan Woo , Euntai Kim

Data classification techniques partition the data or feature space into smaller sub-spaces, each corresponding to a specific class. To classify into subspaces, physical features e.g., distance and distributions are utilized. This approach…

Machine Learning · Computer Science 2025-03-11 Josimar Chire , Khalid Mahmood , Zhao Liang

Very deep convolutional neural networks (CNNs) have been firmly established as the primary methods for many computer vision tasks. However, most state-of-the-art CNNs are large, which results in high inference latency. Recently, depth-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yihui He , Jianing Qian , Jianren Wang , Cindy X. Le , Congrui Hetang , Qi Lyu , Wenping Wang , Tianwei Yue

There is a broad need in the neuroscience community to understand and visualize large-scale recordings of neural activity, big data acquired by tens or hundreds of electrodes simultaneously recording dynamic brain activity over minutes to…

Neurons and Cognition · Quantitative Biology 2015-11-24 Bingni W. Brunton , Lise A. Johnson , Jeffrey G. Ojemann , J. Nathan Kutz