English
Related papers

Related papers: Efficient Brain Network Estimation with Sparse ICA…

200 papers

Modeling non Gaussian and non stationary signals and images has always been one of the most important part of signal and image processing methods. In this paper, first we propose a few new models, all based on using hidden variables for…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ali Mohammad-Djafari

Sparse principal component analysis (sparse PCA) is a widely used technique for dimensionality reduction in multivariate analysis, addressing two key limitations of standard PCA. First, sparse PCA can be implemented in high-dimensional low…

Methodology · Statistics 2025-10-07 Jan O. Bauer

We analyze a practical algorithm for sparse PCA on incomplete and noisy data under a general non-random sampling scheme. The algorithm is based on a semidefinite relaxation of the $\ell_1$-regularized PCA problem. We provide theoretical…

Machine Learning · Statistics 2023-02-06 Hanbyul Lee , Qifan Song , Jean Honorio

We generalize the low-rank decomposition problem, such as principal and independent component analysis (PCA, ICA) for continuous-time vector-valued signals and provide a model-agnostic implicit neural signal representation framework to…

Machine Learning · Computer Science 2025-07-15 Shayan K. Azmoodeh , Krishna Subramani , Paris Smaragdis

In this paper, we propose a learning approach for sparse code multiple access (SCMA) signal detection by using a deep neural network via unfolding the procedure of message passing algorithm (MPA). The MPA can be converted to a sparsely…

Information Theory · Computer Science 2018-08-27 Chao Lu , Wei Xu , Hong Shen , Hua Zhang , Xiaohu You

Independent Component Analysis (ICA) - one of the basic tools in data analysis - aims to find a coordinate system in which the components of the data are independent. In this paper we present Multiple-weighted Independent Component Analysis…

Machine Learning · Computer Science 2019-06-04 Andrzej Bedychaj , Przemysław Spurek , Łukasz Struskim , Jacek Tabor

Independent Component Analysis (ICA) recently has attracted attention in the statistical literature as an alternative to elliptical models. Whereas k-dimensional elliptical densities depend on one single unspecified radial density, however,…

Methodology · Statistics 2013-12-17 Marc Hallin , Chintan Mehta

Sparse coding is an unsupervised learning algorithm that learns a succinct high-level representation of the inputs given only unlabeled data; it represents each input as a sparse linear combination of a set of basis functions. Originally…

Machine Learning · Computer Science 2012-06-26 Roger Grosse , Rajat Raina , Helen Kwong , Andrew Y. Ng

Sparse codes in neuroscience have been suggested to offer certain computational advantages over other neural representations of sensory data. To explore this viewpoint, a sparse code is used to represent natural images in an optimal control…

Machine Learning · Computer Science 2021-01-08 Peter N. Loxley

In recent years, unfolding iterative algorithms as neural networks has become an empirical success in solving sparse recovery problems. However, its theoretical understanding is still immature, which prevents us from fully utilizing the…

Machine Learning · Computer Science 2018-11-06 Xiaohan Chen , Jialin Liu , Zhangyang Wang , Wotao Yin

Extracting information from nonlinear measurements is a fundamental challenge in data analysis. In this work, we consider separable inverse problems, where the data are modeled as a linear combination of functions that depend nonlinearly on…

Signal Processing · Electrical Eng. & Systems 2020-07-07 Brett Bernstein , Sheng Liu , Chrysa Papadaniil , Carlos Fernandez-Granda

Principal component analysis (PCA) is a widely used dimension reduction technique in machine learning and multivariate statistics. To improve the interpretability of PCA, various approaches to obtain sparse principal direction loadings have…

Data Structures and Algorithms · Computer Science 2021-06-07 Agniva Chowdhury , Petros Drineas , David P. Woodruff , Samson Zhou

Sparse principal component analysis (PCA) involves nonconvex optimization for which the global solution is hard to obtain. To address this issue, one popular approach is convex relaxation. However, such an approach may produce suboptimal…

Machine Learning · Statistics 2014-08-25 Zhaoran Wang , Huanran Lu , Han Liu

Deep neural networks perform remarkably well on image classification tasks but remain vulnerable to carefully crafted adversarial perturbations. This work revisits linear dimensionality reduction as a simple, data-adapted defense. We…

Machine Learning · Computer Science 2025-10-08 Killian Steunou , Théo Druilhe , Sigurd Saue

The ventral, dorsal, and lateral streams in high-level human visual cortex are implicated in distinct functional processes. Yet, deep neural networks (DNNs) trained on a single task model the entire visual system surprisingly well, hinting…

Machine Learning · Computer Science 2025-10-13 Ammar I Marvi , Nancy G Kanwisher , Meenakshi Khosla

Although approaches to Independent Component Analysis (ICA) based on characteristic function seem theoretically elegant, they may suffer from implementational challenges because of numerical integration steps or selection of tuning…

Methodology · Statistics 2025-11-07 Vincent Starck

Neuroimaging data can be represented as networks of nodes and edges that capture the topological organization of the brain connectivity. Graph theory provides a general and powerful framework to study these networks and their structure at…

Neurons and Cognition · Quantitative Biology 2017-05-19 Cécile Bordier , Carlo Nicolini , Angelo Bifone

Deep neural networks learn structured features from complex, non-Gaussian inputs, but the mechanisms behind this process remain poorly understood. Our work is motivated by the observation that the first-layer filters learnt by deep…

Machine Learning · Statistics 2025-07-14 Fabiola Ricci , Lorenzo Bardone , Sebastian Goldt

Independent component analysis (ICA) is a statistical method for transforming an observable multidimensional random vector into components that are as statistically independent as possible from each other.Usually the ICA framework assumes a…

Information Theory · Computer Science 2015-08-21 Amichai Painsky , Saharon Rosset , Meir Feder

Linear Independent Component Analysis (ICA) is a blind source separation technique that has been used in various domains to identify independent latent sources from observed signals. In order to obtain a higher signal-to-noise ratio, the…

Machine Learning · Computer Science 2023-12-04 Ambroise Heurtebise , Pierre Ablin , Alexandre Gramfort