English
Related papers

Related papers: Unsupervised learning approaches to characterize h…

200 papers

Dimensionality reduction algorithms like principal component analysis (PCA) are workhorses of machine learning and neuroscience, but each has well-known limitations. Variants of PCA are simple and interpretable, but not flexible enough to…

Machine Learning · Computer Science 2025-12-01 John J. Vastola , Samuel J. Gershman , Kanaka Rajan

Principal component analysis (PCA) is a classical feature extraction method, but it may be adversely affected by outliers, resulting in inaccurate learning of the projection matrix. This paper proposes a robust method to estimate both the…

Machine Learning · Computer Science 2024-08-23 Yingzhuo Deng , Ke Hu , Bo Li , Yao Zhang

Brittle optimization has been observed to adversely impact model likelihoods for regression and VAEs when simultaneously fitting neural network mappings from a (random) variable onto the mean and variance of a dependent Gaussian variable.…

Machine Learning · Computer Science 2020-11-02 Andrew Stirn , David A. Knowles

We consider the problem of learning a mixture of Random Utility Models (RUMs). Despite the success of RUMs in various domains and the versatility of mixture RUMs to capture the heterogeneity in preferences, there has been only limited…

Machine Learning · Statistics 2020-04-01 Devavrat Shah , Dogyoon Song

X-ray single particle imaging (SPI) has offered the potential to visualize structures of biomolecules at near-atomic resolution. However, state-of-the-art structures at X-ray free electron lasers (XFELs) are limited to moderate resolution,…

Optics · Physics 2025-08-12 Abhishek Mall , Zhou Shen , Kartik Ayyer

Principal component analysis (PCA) is a widely used technique for data analysis and dimension reduction with numerous applications in science and engineering. However, the standard PCA suffers from the fact that the principal components…

Optimization and Control · Mathematics 2009-07-14 Zhaosong Lu , Yong Zhang

Principal Components Analysis (PCA) is a common way to study the sources of variation in a high-dimensional data set. Typically, the leading principal components are used to understand the variation in the data or to reduce the dimension of…

Single-pixel imaging (SPI) has a major drawback that many sequential illuminations are required for capturing one single image with long acquisition time. Basis illumination patterns such as Fourier patterns and Hadamard patterns can…

Image and Video Processing · Electrical Eng. & Systems 2020-01-20 Jun Feng , Shuming Jiao , Yang Gao , Ting Lei , Xiaocong Yuan

X-ray single particle imaging involves the measurement of a large number of noisy diffraction patterns of isolated objects in random orientations. The missing information about these patterns is then computationally recovered in order to…

Image and Video Processing · Electrical Eng. & Systems 2020-05-25 Kartik Ayyer

Feature extraction and dimensionality reduction are important tasks in many fields of science dealing with signal processing and analysis. The relevance of these techniques is increasing as current sensory devices are developed with ever…

Machine Learning · Statistics 2013-10-21 Jerónimo Arenas-García , Kaare Brandt Petersen , Gustavo Camps-Valls , Lars Kai Hansen

STEM XEDS spectrum images can be drastically denoised by application of the principal component analysis (PCA). This paper looks inside the PCA workflow step by step on an example of a complex semiconductor structure consisting of a number…

Image and Video Processing · Electrical Eng. & Systems 2019-10-16 Pavel Potapov , Axel Lubk

Spectral methods have been the mainstay in several domains such as machine learning and scientific computing. They involve finding a certain kind of spectral decomposition to obtain basis functions that can capture important structures for…

Machine Learning · Computer Science 2020-04-20 Majid Janzamin , Rong Ge , Jean Kossaifi , Anima Anandkumar

Phylogenetic analysis of DNA or other data commonly gives rise to a collection or sample of inferred evolutionary trees. Principal Components Analysis (PCA) cannot be applied directly to collections of trees since the space of evolutionary…

Statistics Theory · Mathematics 2012-02-24 Tom M. W. Nye

Sparse Principal Component Analysis (sPCA) is a popular matrix factorization approach based on Principal Component Analysis (PCA) that combines variance maximization and sparsity with the ultimate goal of improving data interpretation. When…

Machine Learning · Statistics 2020-11-19 J. Camacho , A. K. Smilde , E. Saccenti , J. A. Westerhuis

In this paper we develop a new approach to sparse principal component analysis (sparse PCA). We propose two single-unit and two block optimization formulations of the sparse PCA problem, aimed at extracting a single sparse dominant…

Optimization and Control · Mathematics 2008-12-01 Michel Journée , Yurii Nesterov , Peter Richtárik , Rodolphe Sepulchre

In this work we introduce a new residual for normal linear models that are suitable for situations in which we are dealing with heteroskedasticity of unknown form, they are referred to by principal component analysis (PCA) residuals. These…

Methodology · Statistics 2017-09-01 Andréa V. Rocha , Evelina Shamarova , Alexandre B. Simas

Recently years, the attempts on distilling mobile data into useful knowledge has been led to the deployment of machine learning algorithms at the network edge. Principal component analysis (PCA) is a classic technique for extracting the…

Information Theory · Computer Science 2022-04-04 Zezhong Zhang , Guangxu Zhu , Rui Wang , Vincent K. N. Lau , Kaibin Huang

Probabilistic principal component analysis (PPCA) seeks a low dimensional representation of a data set in the presence of independent spherical Gaussian noise. The maximum likelihood solution for the model is an eigenvalue problem on the…

Machine Learning · Computer Science 2012-06-22 Alfredo Kalaitzis , Neil Lawrence

Cryo-electron microscopy nowadays often requires the analysis of hundreds of thousands of 2D images as large as a few hundred pixels in each direction. Here we introduce an algorithm that efficiently and accurately performs principal…

Computer Vision and Pattern Recognition · Computer Science 2015-12-16 Zhizhen Zhao , Yoel Shkolnisky , Amit Singer

Pattern formation is a widely observed phenomenon in diverse fields including materials physics, developmental biology and ecology, among many others. The physics underlying the patterns is specific to the mechanisms, and is encoded by…

Computational Engineering, Finance, and Science · Computer Science 2024-03-28 Z. Wang , X. Huan , K. Garikipati